-- Logs begin at Mon 2022-08-01 07:01:55 UTC, end at Mon 2022-08-01 08:25:06 UTC. -- Aug 01 07:51:17.191116 dv-cinder-740146-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 07:51:17.199987 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 07:51:17 2022] *** Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: nodename: dv-cinder-740146-16-iscsi Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: machine: x86_64 Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: clock source: unix Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: pcre jit disabled Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: detected number of CPU cores: 4 Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: current working directory: / Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: detected binary path: /usr/bin/uwsgi-core Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: your processes number limit is 47680 Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: your memory page size is 4096 bytes Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: detected max file descriptor number: 2048 Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: lock engine: pthread robust mutexes Aug 01 07:51:17.202223 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: thunder lock: enabled Aug 01 07:51:17.203240 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 07:51:17.203240 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 07:51:17.241835 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: Python main interpreter initialized at 0x5605e6a7d9c0 Aug 01 07:51:17.241835 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: python threads support enabled Aug 01 07:51:17.241835 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: your server socket listen backlog is limited to 100 connections Aug 01 07:51:17.241835 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: your mercy for graceful operations on workers is 90 seconds Aug 01 07:51:17.242205 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 07:51:17.242284 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: *** Operational MODE: preforking *** Aug 01 07:51:17.242498 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: *** uWSGI is running in multiple interpreter mode *** Aug 01 07:51:17.242498 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: spawned uWSGI master process (pid: 103521) Aug 01 07:51:17.242700 dv-cinder-740146-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 07:51:17.244098 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: spawned uWSGI worker 1 (pid: 103522, cores: 1) Aug 01 07:51:17.244098 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: spawned uWSGI worker 2 (pid: 103523, cores: 1) Aug 01 07:51:17.244098 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 07:51:17.906737 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:51:17.908476 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:51:18.990097 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:51:18.990097 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Aug 01 07:51:18.990691 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:51:18.990691 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: from cryptography.utils import int_from_bytes Aug 01 07:51:18.994818 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:51:18.994818 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: from cryptography.utils import int_from_bytes Aug 01 07:51:18.995236 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:51:18.995236 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: from cryptography.utils import int_from_bytes Aug 01 07:51:21.481509 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:51:21.482096 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:51:21.482284 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:51:21.482655 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:51:21.482895 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:51:21.483152 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:51:21.483508 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.483614 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:51:21.483706 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.483926 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.484027 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:51:21.484241 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.484336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:51:21.484527 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:51:21.484624 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.484865 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.484957 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.485186 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.485279 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.485504 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.485591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.485829 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.485916 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.486088 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.486173 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.486523 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.486625 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.486851 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.486936 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-16-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.487176 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.487260 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.487507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.487631 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.487796 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.487889 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.488117 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.488207 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.488445 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-16-iscsi {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.488539 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.488772 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.488876 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.489070 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.489155 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.489381 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.489570 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.489686 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.490706 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.490846 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.490846 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491044 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491125 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491202 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491334 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491424 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491545 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491675 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491768 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491855 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.491943 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492022 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492163 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492334 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492427 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492742 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.492964 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.493106 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-16-iscsi {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.493290 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.493445 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.493598 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.493762 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.493930 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.494024 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.494215 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.494427 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.494610 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-16-iscsi {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.494735 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.494927 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.495042 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.495241 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.495361 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.495574 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.495710 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.495994 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.496095 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.496306 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.496393 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.496618 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.496711 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.496932 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497025 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497248 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497342 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497548 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497643 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497854 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.497941 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.498162 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.498249 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.498479 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.498645 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.498818 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.498925 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499076 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499163 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499325 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499421 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499650 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499749 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.499973 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500069 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500292 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500391 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500601 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500685 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500848 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.500935 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.501098 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.501186 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.501412 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.501498 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.501728 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.502307 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.502550 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.502702 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.502855 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.503052 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.503143 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.503318 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.503455 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.503674 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.503778 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504005 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504105 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504317 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504415 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504630 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504735 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.504940 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505047 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505250 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505355 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505558 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505655 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505862 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.505970 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.506169 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.506274 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.506479 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.506576 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.506797 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.506901 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.507104 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.507200 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.507426 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.507523 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.507762 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.507869 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.508066 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.508161 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.508383 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.508488 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.508706 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.508804 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509012 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509114 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509310 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509403 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509614 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509700 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.509929 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510023 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510261 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510347 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510563 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510813 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.510911 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.511114 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.511199 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.511419 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.511513 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.511747 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.511922 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.512102 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.512313 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.512495 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.512662 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.512840 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.512990 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.513111 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.513225 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.513489 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.513802 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.514102 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.514210 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.514407 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.514516 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.514709 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.514806 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515013 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515119 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515314 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515444 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515643 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515744 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.515952 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516047 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516260 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516366 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516561 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516666 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516866 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.516963 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.517169 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.517267 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.518072 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.518174 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.518416 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.518557 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.518731 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.518975 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.519063 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.519292 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.519388 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.519627 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.519732 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.519957 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520042 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520277 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520371 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520585 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520679 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520901 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.520996 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.521196 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.521292 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.521496 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.521594 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.521803 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.521889 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.522111 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.522202 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.522415 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.522508 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.522720 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.522806 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523022 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523109 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523325 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523427 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523651 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523763 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.523990 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524084 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524245 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524350 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524550 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524640 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524850 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.524944 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.525165 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.525257 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.525483 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.525568 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.525790 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.525882 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.526092 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.526179 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.526394 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.526480 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.526700 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.526785 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.527006 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.527102 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.527313 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.527399 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.527640 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.527741 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.527950 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.528079 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.528253 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.528339 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.528574 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.528673 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.528899 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.528986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.529211 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.529341 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.529519 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.529619 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.529825 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.529911 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.530136 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.530231 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:51:21.530449 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.530543 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.530760 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.530852 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.531078 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.531163 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.531397 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.531484 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.531750 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.531838 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.532066 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.532151 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.532383 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.532471 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.532699 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.532785 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.533009 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.533128 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.533348 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.533471 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.533695 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.533882 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534109 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534197 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534288 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534430 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534618 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534753 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.534959 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.535078 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.535272 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.535415 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.535618 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.535763 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.535942 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.536083 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.536253 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.536403 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.536564 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.536717 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.536872 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.537036 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.537193 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.537369 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.537520 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.537694 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.537831 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.538008 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.538150 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.538353 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.538461 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.538698 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.538784 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.539013 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.539099 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.539340 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.539439 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.539690 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.539780 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540010 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540105 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540325 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540418 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540637 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540723 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.540945 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541038 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541264 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541358 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541576 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541671 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541886 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.541973 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.542196 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.542288 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.542499 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.542592 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.542804 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.542897 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.543106 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.543200 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.543415 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.543613 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.543747 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.543842 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.544138 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.544245 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.544391 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.544490 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.544698 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.544785 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545018 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545103 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545323 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545408 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545633 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545718 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.545938 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546027 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546247 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546333 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546546 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546632 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546852 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.546944 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.547158 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.547245 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.547462 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.547650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.547811 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.547896 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.548118 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.548206 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.548425 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.548522 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.548771 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.548997 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549089 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549195 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549366 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549496 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549681 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549844 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.549993 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.550087 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.550300 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.550385 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.550609 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.550703 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.550921 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551006 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551230 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551318 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551575 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551678 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551870 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.551958 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.552174 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.552260 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.552502 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.552590 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.552813 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.552902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.553123 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.553218 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.553443 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.553538 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.553756 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.553844 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554061 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554160 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554371 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554470 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554676 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554762 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.554983 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.555068 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.555288 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.555409 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.555623 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.555724 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.555928 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556023 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556235 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556331 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556540 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556626 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556844 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.556938 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.557146 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.557231 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.557467 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.557553 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.557776 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.557875 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558079 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558165 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558381 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558465 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558681 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558776 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.558983 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.559068 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.559296 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.559384 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.559626 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.559715 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.559937 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560022 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560246 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560342 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560554 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560641 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560862 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.560956 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.561188 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.561311 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.561496 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.561585 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.561802 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.561888 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.562109 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.562193 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.562410 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.562496 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.562724 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.562811 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.563033 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.563129 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.563351 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.563445 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.563713 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.563816 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.564003 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.564103 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.564857 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.564980 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.565142 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.565232 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.565449 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.565549 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.565764 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.565851 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.566097 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.566183 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.566413 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.566507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.566728 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.566814 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.567047 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.567132 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.567358 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.567453 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.567697 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.567797 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568010 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568098 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568322 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568409 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568631 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568722 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.568944 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.569029 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.569252 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.569345 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.569559 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.569644 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.569878 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570016 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570187 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570325 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570510 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570646 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570820 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.570950 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.571132 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.571264 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.571436 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.571595 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.571772 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.571917 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.572085 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.572226 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.572400 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.572530 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.572714 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.572867 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.573024 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.573157 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.573336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.573470 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.573644 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.573803 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.574199 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.574357 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.574500 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.574635 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.574805 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.574972 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.575110 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.575202 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.575408 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.575502 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.575749 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.575847 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576061 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576155 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576372 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576467 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576678 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576771 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.576991 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577078 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577299 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577385 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577604 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577691 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577907 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.577992 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.578215 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.578308 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.578523 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.578616 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.578834 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.578920 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.579149 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.579241 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.579466 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.579573 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.579798 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.579896 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.580637 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.580827 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.580962 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.581166 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.581274 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.581490 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.581576 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.581806 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.581893 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.582118 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.582204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.582429 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.582518 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.582748 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.582835 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.583070 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.583163 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.583382 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.583466 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.583724 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.583821 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584036 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584130 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584348 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584446 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584654 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584739 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.584959 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585045 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585280 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585381 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585588 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585681 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585892 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.585977 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.586199 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.586296 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.586506 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.586592 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.586814 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.586899 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.587120 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.587214 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.587443 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.587547 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.587775 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.587862 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.588084 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.588172 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.588392 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.588479 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.588695 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.588781 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589007 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589094 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589321 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589408 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589637 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589885 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.589983 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.590216 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.590309 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.590526 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.590622 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.590840 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.590934 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.591151 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.591238 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.591461 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.591578 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.591806 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.591893 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.592123 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.592208 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.592436 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.592522 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.592745 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.592838 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.593054 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.593141 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.593357 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.593443 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.593662 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.593917 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594011 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594260 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594355 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594562 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594647 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594868 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.594956 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.595198 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.595297 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.595478 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.595627 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.595828 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.595962 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.596133 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.596296 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.596441 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.596637 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.596758 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.596949 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597063 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597264 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597358 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597576 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597662 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597887 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.597982 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.598203 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.598289 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.598513 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.598608 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.598824 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.598911 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.599135 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.599221 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.599447 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.599595 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.599783 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.599870 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.600096 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.600198 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.600406 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.600505 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.600717 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.600810 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601036 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601121 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601338 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601431 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601735 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.601955 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602041 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602261 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602348 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602565 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602651 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602867 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.602953 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.603173 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.603258 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.603476 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.603580 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.603811 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.603915 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.604122 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.604211 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.604431 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.604518 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.604741 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.604827 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605045 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605140 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605357 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605462 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605659 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605754 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.605972 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606065 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606280 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606366 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606583 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606677 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606886 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.606981 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.607195 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.607281 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.607502 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.607638 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.607827 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.607914 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.608137 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.608223 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.608439 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.608535 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.608749 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.608841 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609051 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609135 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609354 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609448 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609652 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609737 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.609959 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610045 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610266 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610361 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610568 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610661 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610872 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.610957 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.611218 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.611366 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.611557 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.611648 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.611871 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.611958 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.612179 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.612273 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.612492 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.612579 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.612799 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.612893 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.613117 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.613204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.613426 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.613511 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.613732 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.613826 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614033 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614118 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614343 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614437 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614646 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614750 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.614950 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615044 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615252 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615337 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615581 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615680 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615887 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.615973 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.616191 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.616276 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.616493 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.616580 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.616795 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.616880 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.617098 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.617190 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.617405 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.617498 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.617719 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.617804 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618025 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618118 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618327 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618421 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618631 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618724 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.618936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619021 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619244 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619332 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619568 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619669 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619885 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.619980 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.620192 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.620286 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.620498 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.620583 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.620803 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.620901 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.621110 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.621204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.621418 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.621511 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.621720 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.621820 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622034 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622121 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622337 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622423 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622644 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622738 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.622943 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623077 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623247 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623351 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623592 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623683 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623907 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.623993 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.624217 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.624305 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.624539 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.624678 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.624860 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.624990 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.625170 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.625297 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.625469 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.625609 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.625778 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.625868 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.626083 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.626167 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.626386 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.626471 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.626694 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.626788 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.627576 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.627674 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.627883 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.628050 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.628191 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.628381 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.628515 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.628704 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.628829 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629019 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629140 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629333 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629464 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629641 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629789 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.629952 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.630114 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.630263 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.630422 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.630571 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.630732 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.630896 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.631043 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.631206 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.631353 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.631511 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.631690 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.631846 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632001 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632152 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632314 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632462 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632630 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632766 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.632944 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.633194 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.633358 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.633505 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.633591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.633816 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.633902 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.634120 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.634215 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.634430 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.634516 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.634737 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.634821 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635048 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635148 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635360 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635447 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635685 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635813 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.635995 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.636104 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.636299 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.636400 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.636611 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.636699 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.636918 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.637006 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.637295 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.637381 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.637601 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.637694 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.637910 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638005 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638233 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638319 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638541 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638628 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638845 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.638932 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.639149 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.639234 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.639465 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.639580 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.639794 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.639881 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.640116 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.640203 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.640513 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.640613 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.640828 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.640924 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.641129 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.641214 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.641434 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.641529 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.641743 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.641829 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.642056 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.642143 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.642384 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.643082 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.643266 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.643697 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.643798 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.643891 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.643981 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.644185 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.644280 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.644506 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.644639 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.644815 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.644913 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.645143 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.645229 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.645472 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.645568 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.645784 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.645916 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.646101 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.646231 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.646409 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.646545 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.646733 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.646858 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.647055 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.647184 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.647371 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.647507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.647720 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.647855 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.648137 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.648237 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.648461 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.648554 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.648770 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.648856 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.649088 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.649181 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.649410 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.649495 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.649713 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.649798 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650019 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650114 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650327 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650412 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650628 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650722 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.650932 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651020 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651255 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651342 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651581 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651672 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651894 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.651990 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.652204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.652299 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.652513 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.652614 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.652816 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.652904 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.653117 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.653230 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.653437 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.653537 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.653737 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.653823 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.654058 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.654144 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.654371 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.654465 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.654690 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.654792 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655011 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655099 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655315 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655410 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655654 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655750 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.655960 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656048 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656262 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656349 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656563 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656649 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656861 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.656947 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.657185 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.657272 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.657492 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.657579 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.657807 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.657891 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.658175 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.658335 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.658503 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.658651 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.658817 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.658958 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.659124 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.659252 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.659453 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.659583 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.659789 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.659889 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.660095 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.660188 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.660405 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.660491 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.660710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.660805 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661014 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661100 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661333 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661434 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661633 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661772 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.661940 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662027 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662246 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662332 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662555 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662858 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.662953 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.663159 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.663246 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.663465 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.663573 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.663817 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.663904 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.664125 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.664223 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.664447 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.664544 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.664758 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.664844 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665061 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665149 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665366 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665453 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665663 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665751 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.665970 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666064 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666284 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666380 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666592 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666678 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666898 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.666997 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.667203 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.667289 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.667574 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.667665 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.667858 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.667958 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.668182 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.668277 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.668496 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.668583 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.668803 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.668898 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.669112 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.669206 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.669418 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.669504 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.669729 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.669816 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670046 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670133 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670365 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670450 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670679 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670767 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.670996 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.671083 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.671311 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.671397 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.671645 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.671735 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.671974 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.672171 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.672296 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.672498 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.672618 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.672814 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.672938 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.673127 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.673258 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.673440 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.673569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.673801 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.673950 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.674109 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.674246 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.674423 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.674601 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.674735 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.674866 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.675038 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.675185 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.675333 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.675492 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.675689 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.675982 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.676116 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.676309 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.676415 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.676645 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.676733 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.676957 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677049 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677269 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677356 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677580 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677665 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677892 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.677978 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.678204 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.678291 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.678517 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.678604 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.678830 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.678925 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.679142 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.679229 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.679459 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.679566 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.679799 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.679899 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.680110 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.680197 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.680420 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.680507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.680736 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.680899 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681048 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681135 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681358 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681445 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681668 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681756 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.681982 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.682068 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.682295 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.682383 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.682618 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.682706 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.682932 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683017 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683254 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683349 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683584 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683673 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683899 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.683986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.684214 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.684308 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.684527 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.684732 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.684847 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.685049 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.685175 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.685381 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.685484 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.685709 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.685809 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686034 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686121 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686350 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686487 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686664 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686801 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.686988 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.687131 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.687294 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.687424 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.687620 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.687753 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.687930 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.688135 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.688269 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.688448 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.688584 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.688767 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.688906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.689105 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.689241 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.689951 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.690094 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.690270 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.690485 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.690631 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.690790 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.691094 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.691225 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.691430 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.691587 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.691769 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.691856 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.692076 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.692162 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.692391 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.692486 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.692707 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.692793 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693008 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693094 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693330 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693430 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693631 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693716 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.693937 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.694023 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.694247 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.694335 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.694556 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.694641 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.694859 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.695095 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.695189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.695443 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.695569 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.695774 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.695906 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.696080 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.696186 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.696388 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.696479 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.696692 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.696779 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697018 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697113 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697325 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697415 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697629 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697715 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.697934 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.698028 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.698242 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.698328 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.698544 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.698631 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.698846 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.699190 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.699413 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.699500 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.699739 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.699825 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700051 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700138 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700351 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700437 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700660 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700752 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.700960 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701046 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701269 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701363 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701574 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701669 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701880 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.701966 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.702190 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.702278 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.702506 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.702606 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.702814 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.702900 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.703111 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.703203 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.703416 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.703511 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.703750 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.703840 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.704065 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.704152 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.704372 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.704468 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.704681 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.704767 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.705072 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.705697 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.705948 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.706061 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.706284 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.706530 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.706619 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.706866 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.706966 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.707190 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.707277 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.707653 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.707751 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.707872 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.707972 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.708179 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.708265 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.708488 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.708576 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.708794 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.708889 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.709111 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.709197 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.709422 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.709508 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.709731 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.709819 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.710039 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.710126 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.710348 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.710591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.710688 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.710929 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711023 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711242 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711328 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711565 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711672 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711876 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.711964 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.712183 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.712271 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.712490 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.712590 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.712799 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.712886 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.713104 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.713192 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.713412 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.713500 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.713725 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.713812 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714034 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714120 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714351 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714438 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714668 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714761 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.714978 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.715064 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.715289 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.715382 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.715620 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.715726 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.715929 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716050 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716238 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716335 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716541 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716685 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716849 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.716946 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.717162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.717249 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.717471 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.717556 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.717775 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.717870 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.718118 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.718203 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.718440 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.718526 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.718763 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.718852 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.719085 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.719179 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.719394 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.719480 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.719742 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.719831 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.720055 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.720150 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.720361 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.720448 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.721210 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.721352 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.721519 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.721608 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.721847 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.722050 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.722184 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.722373 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.722513 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.722687 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.722837 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.723113 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.723200 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.723430 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.723515 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.723755 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.723842 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724064 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724152 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724380 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724466 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724688 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724782 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.724989 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.725076 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.725291 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.725387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.725597 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.725692 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.725898 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726030 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726202 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726344 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726504 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726645 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726806 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.726895 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.727109 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.727196 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.727410 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.727510 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.727735 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.727826 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728037 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728123 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728338 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728426 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728639 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728731 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.728940 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729026 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729244 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729332 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729548 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729643 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729850 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.729936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.730147 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.730235 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.730467 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.730601 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.730756 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.730864 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.731057 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.731149 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.731369 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.731458 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.731749 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.731856 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732009 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732098 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732315 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732405 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732621 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732721 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.732926 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733023 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733228 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733324 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733539 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733639 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733845 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.733934 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.734152 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.734239 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.734451 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.734548 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.734766 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.734865 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.735071 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.735159 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.735377 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.735466 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.735711 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.735814 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.736025 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.736189 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.736884 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.737215 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.737352 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.737539 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.737680 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.737846 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.737986 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.738171 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.738301 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.738487 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.738618 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.738807 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.738938 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.739123 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.739253 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.739439 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.739600 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.739791 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.739879 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.740100 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.740188 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.740409 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.740495 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.740718 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.740814 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741027 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741122 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741334 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741430 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741644 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741736 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.741951 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742036 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742259 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742359 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742572 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742659 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742885 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.742973 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.743202 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.743297 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.743521 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.743652 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.743851 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.743939 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.744168 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.744266 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.744489 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.744576 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.744806 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.744899 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.745123 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.745211 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.745439 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.745526 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.745758 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.745849 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746074 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746198 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746386 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746473 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746692 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746785 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.746992 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:51:21.747127 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.747313 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.747656 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.747991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.748321 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.748635 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.748966 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.749294 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.749645 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.749963 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.750312 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.750645 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.751304 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.751304 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.751600 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:51:21.751902 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103522) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:51:21.900798 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Registered counter for database nova_api Aug 01 07:51:21.904624 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO dbcounter [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Registered counter for database nova_api Aug 01 07:51:21.923210 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:21.924902 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_db.sqlalchemy.engines [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:21.928769 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:21.931334 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writer thread running {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:21.985106 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.context [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7e949bb-6181-44eb-9611-dda4f19e218a(cell1) {{(pid=103523) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:51:21.987587 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.context [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7e949bb-6181-44eb-9611-dda4f19e218a(cell1) {{(pid=103522) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:51:21.989552 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:51:21.991135 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:51:21.991509 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_concurrency.lockutils [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:51:21.991957 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:51:21.993121 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_concurrency.lockutils [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:51:21.993923 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:51:21.994037 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_concurrency.lockutils [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:51:21.995905 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_concurrency.lockutils [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103522) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:51:21.996011 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Registered counter for database nova_cell0 Aug 01 07:51:21.997861 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO dbcounter [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Registered counter for database nova_cell0 Aug 01 07:51:22.001307 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Registered counter for database nova_cell1 Aug 01 07:51:22.003947 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO dbcounter [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Registered counter for database nova_cell1 Aug 01 07:51:22.009005 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:22.010901 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:22.016398 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:22.016561 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_db.sqlalchemy.engines [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:22.017242 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_db.sqlalchemy.engines [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:22.019052 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:22.024896 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writer thread running {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:22.025229 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writer thread running {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:22.163801 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO dbcounter [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Registered counter for database nova_cell0 Aug 01 07:51:22.167968 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO dbcounter [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Registered counter for database nova_cell0 Aug 01 07:51:22.173009 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_db.sqlalchemy.engines [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:22.177516 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG oslo_db.sqlalchemy.engines [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103522) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:51:22.178211 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writer thread running {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:22.181806 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writer thread running {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:51:22.616768 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:51:22.624067 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:51:22.632630 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: WARNING keystonemiddleware.auth_token [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:51:22.639872 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: WARNING keystonemiddleware.auth_token [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:51:22.968952 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:51:22.975088 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: WARNING keystonemiddleware.auth_token [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:51:22.980371 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605e6a7d9c0 pid: 103523 (default app) Aug 01 07:51:22.982453 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:51:22.983085 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: WARNING keystonemiddleware.auth_token [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:51:22.983662 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001752 Aug 01 07:51:22.984074 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Aug 1 07:51:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:51:22.989394 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: WARNING keystonemiddleware.auth_token [None req-0c0568c4-d258-4dc7-8696-16028f938cde None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:51:22.994632 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5605e6a7d9c0 pid: 103522 (default app) Aug 01 07:52:41.796696 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:41.797690 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 01 07:52:41.798083 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:52:41.809600 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writing DB stats nova_api:SELECT=3 {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:41.810985 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writing DB stats nova_cell0:SELECT=3 {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:41.812027 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writing DB stats nova_cell1:SELECT=3 {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:41.813071 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:42.707604 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-22408be8-29a6-467a-b49a-6b4796894f2c admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:42.740864 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-22408be8-29a6-467a-b49a-6b4796894f2c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.936011 Aug 01 07:52:42.741785 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 07:52:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:52:44.971693 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:44.972702 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-16605a34-d104-40c9-907c-e6d0682816bc None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 01 07:52:44.973293 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:52:45.450494 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-4270c865-9019-4843-a232-3cbac979c5b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "c1", "name": "cirros256", "disk": 1}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:45.477467 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:52:45.477467 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: warnings.warn(msg) Aug 01 07:52:45.560761 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-4270c865-9019-4843-a232-3cbac979c5b7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.581139 Aug 01 07:52:45.561270 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:52:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:52:45.575289 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:45.577067 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:45.578171 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=3 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:45.579031 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:52:45.786018 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-1f82fd2e-1b64-4e0e-ad96-8cd209507b12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:45.790315 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:52:45.790315 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 01 07:52:45.895762 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-1f82fd2e-1b64-4e0e-ad96-8cd209507b12 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.325942 Aug 01 07:52:45.896341 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 07:52:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:52:48.141711 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-4270c865-9019-4843-a232-3cbac979c5b7 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:48.142726 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-4270c865-9019-4843-a232-3cbac979c5b7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 01 07:52:48.143332 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:52:48.818067 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-69540783-9ca4-4b8a-aafa-e505a87614fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:48.838051 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:52:48.838051 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 01 07:52:48.905694 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-69540783-9ca4-4b8a-aafa-e505a87614fc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.756598 Aug 01 07:52:48.906468 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:52:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:52:48.918394 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-8d246f9d-7e87-4c3f-a2bb-c274ded4141c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:48.922301 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:52:48.922301 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: warnings.warn(msg) Aug 01 07:52:49.028253 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-8d246f9d-7e87-4c3f-a2bb-c274ded4141c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113662 Aug 01 07:52:49.029277 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 07:52:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:52:51.280098 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-69540783-9ca4-4b8a-aafa-e505a87614fc admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:51.281109 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-69540783-9ca4-4b8a-aafa-e505a87614fc admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 01 07:52:51.281677 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:52:51.700354 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-50dace43-758a-42c4-aabd-06d47938771a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 1024, "name": "ds1G"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:51.784890 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-50dace43-758a-42c4-aabd-06d47938771a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497387 Aug 01 07:52:51.785458 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:52:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:52:51.798230 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-7c3797d5-8b6c-419c-990f-b4c61bff79d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:51.867587 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-7c3797d5-8b6c-419c-990f-b4c61bff79d8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073835 Aug 01 07:52:51.868153 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 07:52:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:52:54.087810 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-50dace43-758a-42c4-aabd-06d47938771a admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:54.089403 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-50dace43-758a-42c4-aabd-06d47938771a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Aug 01 07:52:54.089802 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:52:54.541889 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-486a1054-9ee5-41e6-ab84-775c849bc029 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:54.616850 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-486a1054-9ee5-41e6-ab84-775c849bc029 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519669 Aug 01 07:52:54.617997 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:52:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:52:54.630442 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9f61855c-c25b-484d-8285-a341938e8e2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:54.803790 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9f61855c-c25b-484d-8285-a341938e8e2c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.176806 Aug 01 07:52:54.804723 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 07:52:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:52:57.008785 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-486a1054-9ee5-41e6-ab84-775c849bc029 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:57.010046 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-486a1054-9ee5-41e6-ab84-775c849bc029 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 01 07:52:57.010529 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:52:57.459481 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a8fe93c2-cf17-417f-9e5c-a42fb4235457 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:57.539097 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-a8fe93c2-cf17-417f-9e5c-a42fb4235457 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.521965 Aug 01 07:52:57.545413 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:52:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:52:57.552765 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-c82e0e96-38ea-441d-9714-720e94b1c20d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:52:57.646043 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-c82e0e96-38ea-441d-9714-720e94b1c20d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097579 Aug 01 07:52:57.646621 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 07:52:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:52:59.911512 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a8fe93c2-cf17-417f-9e5c-a42fb4235457 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:52:59.912560 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-a8fe93c2-cf17-417f-9e5c-a42fb4235457 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 01 07:52:59.912963 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:52:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:00.327289 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e5b09bfc-b653-475e-93a1-c02d16e07ede admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:00.355662 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e5b09bfc-b653-475e-93a1-c02d16e07ede admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.436275 Aug 01 07:53:00.356356 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 07:52:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:53:03.041570 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a8fe93c2-cf17-417f-9e5c-a42fb4235457 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:03.042529 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-a8fe93c2-cf17-417f-9e5c-a42fb4235457 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 01 07:53:03.042959 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:03.465925 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9d010c33-a79e-44ba-8002-3262b4ff66b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:03.533306 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9d010c33-a79e-44ba-8002-3262b4ff66b6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482132 Aug 01 07:53:03.534086 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:53:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:53:03.546957 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-019df766-d623-4d12-8f46-c5b1c08e7ff2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:03.629410 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-019df766-d623-4d12-8f46-c5b1c08e7ff2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086713 Aug 01 07:53:03.633195 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 07:53:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:53:05.949624 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-9d010c33-a79e-44ba-8002-3262b4ff66b6 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:05.951204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-9d010c33-a79e-44ba-8002-3262b4ff66b6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002018 Aug 01 07:53:05.951868 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:06.489328 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-ee32379a-6d4a-442b-99e9-0dedc9c1dce0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "2", "ram": 2048}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:06.572846 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-ee32379a-6d4a-442b-99e9-0dedc9c1dce0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.615493 Aug 01 07:53:06.573390 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:53:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:53:06.585509 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-b31abf30-c89f-496f-ac67-dc0c7e586b9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:06.663602 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-b31abf30-c89f-496f-ac67-dc0c7e586b9c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074858 Aug 01 07:53:06.663602 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 07:53:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:53:08.848996 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-ee32379a-6d4a-442b-99e9-0dedc9c1dce0 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:08.850007 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-ee32379a-6d4a-442b-99e9-0dedc9c1dce0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 01 07:53:08.850604 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:09.292925 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cd841eb1-e958-4402-9550-ae3e7d4273b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "rxtx_factor": 1.0}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:09.371072 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cd841eb1-e958-4402-9550-ae3e7d4273b9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.514620 Aug 01 07:53:09.372357 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:53:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:53:09.384196 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-ffcba040-5035-4312-94fe-f1d6877bb1f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:09.466851 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-ffcba040-5035-4312-94fe-f1d6877bb1f3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086180 Aug 01 07:53:09.467441 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 07:53:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:53:11.722975 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-cd841eb1-e958-4402-9550-ae3e7d4273b9 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:11.724010 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-cd841eb1-e958-4402-9550-ae3e7d4273b9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 01 07:53:11.727683 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:12.181389 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-dcf780ff-4dbc-4137-ac37-c06241edfb21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "id": "4"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:12.188468 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:53:12.251658 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-dcf780ff-4dbc-4137-ac37-c06241edfb21 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521249 Aug 01 07:53:12.259970 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:53:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:53:12.265879 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-162e75e6-bb70-4c4d-8d79-69d581a2f907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:12.347906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-162e75e6-bb70-4c4d-8d79-69d581a2f907 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086882 Aug 01 07:53:12.348871 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 07:53:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:53:14.592771 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-dcf780ff-4dbc-4137-ac37-c06241edfb21 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:14.593784 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-dcf780ff-4dbc-4137-ac37-c06241edfb21 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 01 07:53:14.594190 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:15.159266 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-6eb62bd8-5da5-4f8f-88b2-0c13450d21a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "id": "5", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:15.720924 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-6eb62bd8-5da5-4f8f-88b2-0c13450d21a0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.119947 Aug 01 07:53:15.721475 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 07:53:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:53:15.734884 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-e80f900f-e810-4676-b2b9-20c0e4e3647b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:15.845524 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-e80f900f-e810-4676-b2b9-20c0e4e3647b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115501 Aug 01 07:53:15.846299 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 07:53:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:53:34.754042 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-6eb62bd8-5da5-4f8f-88b2-0c13450d21a0 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:34.755052 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-6eb62bd8-5da5-4f8f-88b2-0c13450d21a0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 01 07:53:34.755453 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:35.144577 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-cd8bc433-293f-4d58-a1b5-24adec1e763f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:35.163171 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-cd8bc433-293f-4d58-a1b5-24adec1e763f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400705 Aug 01 07:53:35.163788 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 07:53:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:53:36.233528 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-6eb62bd8-5da5-4f8f-88b2-0c13450d21a0 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:36.234541 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-6eb62bd8-5da5-4f8f-88b2-0c13450d21a0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 01 07:53:36.234966 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:36.758032 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-caaf443d-2360-4eb4-b9a1-c6d18a779a19 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:36.764309 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.wsgi [None req-caaf443d-2360-4eb4-b9a1-c6d18a779a19 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-caaf443d-2360-4eb4-b9a1-c6d18a779a19 admin admin] Request method failure captured: Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Accept: application/json Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Accept-Encoding: gzip, deflate Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Connection: keep-alive Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Content-Length: 0 Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Host: 10.222.0.48 Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Openstack-Api-Version: compute 2.90 Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Openstack-System-Scope: None Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: User-Agent: python-novaclient Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Auth-Token: gAAAAABi54aAv58BMwYoiY1ZmsatGces5orMnUKiPb6lhvcWRr8v6zaRMcPkUlLuq2VLf7FYIsMhUZTDMqCcO-HPLoAfpcCO7FPs3O9RBnuHWFDOUgmE-KnaTagy1oxVz9Tdcm7gRC4Zt7UNpHqe20FGenqmlSiu_hAi3_bx7CGWtNy_ZbgvcKE Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Domain-Id: None Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Domain-Name: None Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Identity-Status: Confirmed Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Is-Admin-Project: True Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Domain-Id: default Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Domain-Name: Default Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Name: admin Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Role: member,admin,reader Aug 01 07:53:36.767710 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Roles: member,admin,reader Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5b4d36fd27fd480aad590e2c1f973948", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant: admin Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant-Name: admin Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User: admin Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Domain-Id: default Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Domain-Name: Default Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Id: 3ab27936a00c428f91a5c67560723447 Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Name: admin Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: method: > Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: exception: Flavor 42 could not be found. Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: action_args: {'id': '42'} Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:53:36.769387 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:36.770326 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.771507 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-caaf443d-2360-4eb4-b9a1-c6d18a779a19 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:53:36.772650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-caaf443d-2360-4eb4-b9a1-c6d18a779a19 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393978 Aug 01 07:53:36.772650 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 07:53:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:53:36.778902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-df89da84-5a0b-4c77-865f-49ccafcf3e27 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:36.783110 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:53:36.801323 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-df89da84-5a0b-4c77-865f-49ccafcf3e27 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025986 Aug 01 07:53:36.801891 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 07:53:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:53:36.812337 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-6211f3fc-a256-4e31-8ff5-c70dff57d06f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:36.836585 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-6211f3fc-a256-4e31-8ff5-c70dff57d06f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028531 Aug 01 07:53:36.837126 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 07:53:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:53:36.847194 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e414dfb4-f638-4fdf-9100-b752b727fabc admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:36.853195 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-e414dfb4-f638-4fdf-9100-b752b727fabc admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e414dfb4-f638-4fdf-9100-b752b727fabc admin admin] Request method failure captured: Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Host: 10.222.0.48 Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi54aAv58BMwYoiY1ZmsatGces5orMnUKiPb6lhvcWRr8v6zaRMcPkUlLuq2VLf7FYIsMhUZTDMqCcO-HPLoAfpcCO7FPs3O9RBnuHWFDOUgmE-KnaTagy1oxVz9Tdcm7gRC4Zt7UNpHqe20FGenqmlSiu_hAi3_bx7CGWtNy_ZbgvcKE Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Role: member,admin,reader Aug 01 07:53:36.857189 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Roles: member,admin,reader Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5b4d36fd27fd480aad590e2c1f973948", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User: admin Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Id: 3ab27936a00c428f91a5c67560723447 Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: method: > Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: exception: Flavor 42 could not be found. Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: action_args: {'id': '42'} Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:53:36.866228 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:36.867222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:36.868617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-e414dfb4-f638-4fdf-9100-b752b727fabc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:53:36.869845 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-e414dfb4-f638-4fdf-9100-b752b727fabc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015007 Aug 01 07:53:36.869845 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 07:53:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 07:53:37.942094 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-6211f3fc-a256-4e31-8ff5-c70dff57d06f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:37.943127 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-6211f3fc-a256-4e31-8ff5-c70dff57d06f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 01 07:53:37.943588 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:38.471787 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-0dfbff58-6e96-446f-b063-e2b63dce4d8a admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:38.477098 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-0dfbff58-6e96-446f-b063-e2b63dce4d8a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-0dfbff58-6e96-446f-b063-e2b63dce4d8a admin admin] Request method failure captured: Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Host: 10.222.0.48 Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi54aBDB4Jx-6T7ANtVtkHpQTniYwuu1LR_fCEl2SEb1v4H64pL9w-f5xJaONMpkplVLi54cYdqqMAtlT3COf80xVugRc5p5zR2veBPe3FH8Wiykb4wBLioPo7Unso7Ca8MIRnlnuNJHJsJ9zbqeHGLgw85HY9P8ypTpfwmT65WBp5N2g Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Role: member,admin,reader Aug 01 07:53:38.478632 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Roles: member,admin,reader Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5b4d36fd27fd480aad590e2c1f973948", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User: admin Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Id: 3ab27936a00c428f91a5c67560723447 Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: method: > Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: exception: Flavor 84 could not be found. Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: action_args: {'id': '84'} Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:53:38.480902 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:38.481906 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.483353 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-0dfbff58-6e96-446f-b063-e2b63dce4d8a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:53:38.484641 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-0dfbff58-6e96-446f-b063-e2b63dce4d8a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398663 Aug 01 07:53:38.484641 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 07:53:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:53:38.490744 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-eaae895c-9732-4180-a7ad-8c13a6d03b77 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:38.505450 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-eaae895c-9732-4180-a7ad-8c13a6d03b77 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018340 Aug 01 07:53:38.505990 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 07:53:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:53:38.515421 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-465476ab-56de-4fd3-8a86-550d463452df admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:38.530602 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-465476ab-56de-4fd3-8a86-550d463452df admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018727 Aug 01 07:53:38.531116 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 07:53:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:53:38.540283 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a85dc070-ca4c-4804-9362-c35013fda494 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:38.546580 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.wsgi [None req-a85dc070-ca4c-4804-9362-c35013fda494 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a85dc070-ca4c-4804-9362-c35013fda494 admin admin] Request method failure captured: Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Accept: application/json Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Accept-Encoding: gzip, deflate Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Connection: keep-alive Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Content-Length: 0 Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Host: 10.222.0.48 Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Openstack-Api-Version: compute 2.90 Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Openstack-System-Scope: None Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: User-Agent: python-novaclient Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Auth-Token: gAAAAABi54aBDB4Jx-6T7ANtVtkHpQTniYwuu1LR_fCEl2SEb1v4H64pL9w-f5xJaONMpkplVLi54cYdqqMAtlT3COf80xVugRc5p5zR2veBPe3FH8Wiykb4wBLioPo7Unso7Ca8MIRnlnuNJHJsJ9zbqeHGLgw85HY9P8ypTpfwmT65WBp5N2g Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Domain-Id: None Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Domain-Name: None Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Identity-Status: Confirmed Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Is-Admin-Project: True Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Domain-Id: default Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Domain-Name: Default Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Name: admin Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Role: member,admin,reader Aug 01 07:53:38.548162 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Roles: member,admin,reader Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5b4d36fd27fd480aad590e2c1f973948", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant: admin Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant-Name: admin Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User: admin Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Domain-Id: default Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Domain-Name: Default Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Id: 3ab27936a00c428f91a5c67560723447 Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Name: admin Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: method: > Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: exception: Flavor 84 could not be found. Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: action_args: {'id': '84'} Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:53:38.549591 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:38.551336 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:38.552793 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a85dc070-ca4c-4804-9362-c35013fda494 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:53:38.553999 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-a85dc070-ca4c-4804-9362-c35013fda494 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012820 Aug 01 07:53:38.553999 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 07:53:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:53:39.515138 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-465476ab-56de-4fd3-8a86-550d463452df admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:39.516222 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-465476ab-56de-4fd3-8a86-550d463452df admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 01 07:53:39.516616 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:40.037117 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-51d2cdc7-2d93-43bb-ab23-fc4f6e78808c admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:40.043465 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.wsgi [None req-51d2cdc7-2d93-43bb-ab23-fc4f6e78808c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-51d2cdc7-2d93-43bb-ab23-fc4f6e78808c admin admin] Request method failure captured: Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Accept: application/json Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Accept-Encoding: gzip, deflate Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Connection: keep-alive Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Content-Length: 0 Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Host: 10.222.0.48 Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Openstack-Api-Version: compute 2.90 Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Openstack-System-Scope: None Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: User-Agent: python-novaclient Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Auth-Token: gAAAAABi54aDFol0Khzww8YcfkE43GX3Z8hJbY8rz1mv3FG76LcK5AuO2eeQwt6fPhBPpaZ5cc8XfY-T6mrCW69SJ-gwM4rOYBNOChhjt2E0EN3gRd7hqMjjoLhlAJ69T3P1udRPiOTaA-R_eY7AXiB0y8WNuOkuHD0BhkyLXZv91Usa095zuWo Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Domain-Id: None Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Domain-Name: None Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Identity-Status: Confirmed Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Is-Admin-Project: True Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Domain-Id: default Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Domain-Name: Default Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Project-Name: admin Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Role: member,admin,reader Aug 01 07:53:40.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Roles: member,admin,reader Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5b4d36fd27fd480aad590e2c1f973948", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant: admin Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-Tenant-Name: admin Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User: admin Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Domain-Id: default Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Domain-Name: Default Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Id: 3ab27936a00c428f91a5c67560723447 Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: X-User-Name: admin Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: method: > Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: exception: Flavor 451 could not be found. Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: action_args: {'id': '451'} Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:53:40.046569 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:40.047567 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-51d2cdc7-2d93-43bb-ab23-fc4f6e78808c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103522) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:53:40.050184 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-51d2cdc7-2d93-43bb-ab23-fc4f6e78808c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390698 Aug 01 07:53:40.050184 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 07:53:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:53:40.055960 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-a8230808-a541-4201-abfe-c58956717c70 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:40.071623 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-a8230808-a541-4201-abfe-c58956717c70 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019202 Aug 01 07:53:40.072136 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 07:53:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:53:40.081854 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:40.096952 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018593 Aug 01 07:53:40.097470 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 07:53:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:53:40.106617 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-767c3bcc-57d4-4d3f-9db5-57d45d5fe248 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:40.111914 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.wsgi [None req-767c3bcc-57d4-4d3f-9db5-57d45d5fe248 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-767c3bcc-57d4-4d3f-9db5-57d45d5fe248 admin admin] Request method failure captured: Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Accept: application/json Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Accept-Encoding: gzip, deflate Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Connection: keep-alive Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Content-Length: 0 Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Host: 10.222.0.48 Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Openstack-Api-Version: compute 2.90 Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Openstack-System-Scope: None Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: User-Agent: python-novaclient Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Auth-Token: gAAAAABi54aDFol0Khzww8YcfkE43GX3Z8hJbY8rz1mv3FG76LcK5AuO2eeQwt6fPhBPpaZ5cc8XfY-T6mrCW69SJ-gwM4rOYBNOChhjt2E0EN3gRd7hqMjjoLhlAJ69T3P1udRPiOTaA-R_eY7AXiB0y8WNuOkuHD0BhkyLXZv91Usa095zuWo Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Domain-Id: None Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Domain-Name: None Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Identity-Status: Confirmed Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Is-Admin-Project: True Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Domain-Id: default Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Domain-Name: Default Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Project-Name: admin Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Role: member,admin,reader Aug 01 07:53:40.113413 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Roles: member,admin,reader Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5b4d36fd27fd480aad590e2c1f973948", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5b4d36fd27fd480aad590e2c1f973948"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant: admin Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant-Id: 5b4d36fd27fd480aad590e2c1f973948 Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-Tenant-Name: admin Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User: admin Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Domain-Id: default Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Domain-Name: Default Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Id: 3ab27936a00c428f91a5c67560723447 Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: X-User-Name: admin Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: method: > Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: exception: Flavor 451 could not be found. Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: action_args: {'id': '451'} Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 07:53:40.114986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:40.116204 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: ERROR nova.api.openstack.wsgi Aug 01 07:53:40.117507 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-767c3bcc-57d4-4d3f-9db5-57d45d5fe248 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 07:53:40.118797 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-767c3bcc-57d4-4d3f-9db5-57d45d5fe248 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011798 Aug 01 07:53:40.118797 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 07:53:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 07:53:41.092019 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:41.093022 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 01 07:53:41.093412 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 07:53:41.614436 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-0d7e065a-a1b1-414b-ad11-428409df4562 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:41.694917 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-0d7e065a-a1b1-414b-ad11-428409df4562 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.462494 Aug 01 07:53:41.695360 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 07:53:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:53:42.663096 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:42.664134 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 01 07:53:42.664673 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:43.185271 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-d294563b-c6a7-4776-9be7-d8278d136898 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:43.278875 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-d294563b-c6a7-4776-9be7-d8278d136898 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.473326 Aug 01 07:53:43.279421 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 07:53:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:53:44.259399 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:44.260530 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 01 07:53:44.260930 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:44.796895 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-5c95166b-8bb1-4794-bc6f-1e7e20d2e0a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:44.885361 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-5c95166b-8bb1-4794-bc6f-1e7e20d2e0a2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.484698 Aug 01 07:53:44.886024 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 07:53:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 07:53:45.858184 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:45.859194 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 01 07:53:45.859615 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:46.383297 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-4cba0d4b-aec5-4a64-bbf4-780ef9ce2ba4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 07:53:46.460281 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-4cba0d4b-aec5-4a64-bbf4-780ef9ce2ba4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.458962 Aug 01 07:53:46.460797 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 07:53:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:53:47.466757 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:47.467796 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 01 07:53:47.468188 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:53:48.025710 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-817f61d6-b9ed-4824-a77c-75ea96fddad4 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:53:48.046182 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-817f61d6-b9ed-4824-a77c-75ea96fddad4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.420515 Aug 01 07:53:48.046709 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Aug 1 07:53:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:54:40.505377 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:54:40.506378 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-9c947b42-0508-473f-b5e3-b65749fdcf7f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 01 07:54:40.506769 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 07:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:54:40.518041 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:54:40.902647 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-02dc2af7-a324-4e59-bf37-ca1fbd55dc2e admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:54:40.923180 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-02dc2af7-a324-4e59-bf37-ca1fbd55dc2e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409538 Aug 01 07:54:40.923665 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 07:54:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 07:54:40.945472 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG dbcounter [-] [103522] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103522) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:54:40.949188 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-a5c89234-0ffc-48de-9afb-b26bd29c692d admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:54:40.956778 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-a5c89234-0ffc-48de-9afb-b26bd29c692d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012739 Aug 01 07:54:40.957296 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Aug 1 07:54:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:54:40.968912 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-4b994f76-9f8b-47ed-9464-883900a1e34b admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:54:40.977152 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-4b994f76-9f8b-47ed-9464-883900a1e34b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011880 Aug 01 07:54:40.977662 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Aug 1 07:54:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:54:40.988909 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:54:40.997150 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012034 Aug 01 07:54:40.997669 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Aug 1 07:54:40 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 07:54:41.008805 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-15954c22-55b7-4634-86d1-b6d90b5f5468 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:54:41.016320 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-15954c22-55b7-4634-86d1-b6d90b5f5468 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011124 Aug 01 07:54:41.016824 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Aug 1 07:54:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 07:58:08.045980 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:08.046970 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 01 07:58:08.047353 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:58:08.189520 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=6 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:58:08.349620 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-54e18fff-2aca-400e-95ef-ee4e2eb79e82 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:08.351986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:58:08.351986 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 01 07:58:08.353219 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-54e18fff-2aca-400e-95ef-ee4e2eb79e82 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:08.353663 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-54e18fff-2aca-400e-95ef-ee4e2eb79e82 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:08.354441 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-54e18fff-2aca-400e-95ef-ee4e2eb79e82 admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:08.354870 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-54e18fff-2aca-400e-95ef-ee4e2eb79e82 admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:08.388807 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-54e18fff-2aca-400e-95ef-ee4e2eb79e82 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.200880 Aug 01 07:58:08.389362 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 07:58:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:58:09.222295 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:09.223329 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 01 07:58:09.223775 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:58:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:58:09.413900 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-78b15398-1d23-4d57-ac0f-4decf4c62a76 admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:09.416306 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:58:09.416306 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 01 07:58:09.417482 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-78b15398-1d23-4d57-ac0f-4decf4c62a76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:09.417916 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-78b15398-1d23-4d57-ac0f-4decf4c62a76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:09.418688 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-78b15398-1d23-4d57-ac0f-4decf4c62a76 admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:09.419109 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-78b15398-1d23-4d57-ac0f-4decf4c62a76 admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:09.439285 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-78b15398-1d23-4d57-ac0f-4decf4c62a76 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076166 Aug 01 07:58:09.439789 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 07:58:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 07:58:20.678290 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:20.679322 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 01 07:58:20.679730 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:58:20.823800 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell0:SELECT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:58:20.824586 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_cell1:SELECT=4 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:58:20.825169 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG dbcounter [-] [103523] Writing DB stats nova_api:SELECT=8 {{(pid=103523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 07:58:20.874143 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-f610f7db-57ca-4cc8-827d-ff399d35bb0f admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:20.876676 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:58:20.876676 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 01 07:58:20.877845 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f610f7db-57ca-4cc8-827d-ff399d35bb0f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:20.878344 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f610f7db-57ca-4cc8-827d-ff399d35bb0f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:20.879170 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f610f7db-57ca-4cc8-827d-ff399d35bb0f admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:20.879725 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-f610f7db-57ca-4cc8-827d-ff399d35bb0f admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:20.905306 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-f610f7db-57ca-4cc8-827d-ff399d35bb0f admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085872 Aug 01 07:58:20.905788 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 07:58:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:58:21.749640 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: DEBUG nova.api.openstack.wsgi [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] Calling method '>' {{(pid=103522) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:21.750638 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: INFO nova.api.openstack.requestlog [None req-31a1dbf8-bbf0-42a7-8280-bb928b37d9a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 01 07:58:21.751032 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: [pid: 103522|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 07:58:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 07:58:21.941842 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG nova.api.openstack.wsgi [None req-4a03adbe-405a-42ae-a2d1-f9d89ac0ee4c admin admin] Calling method '>' {{(pid=103523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 07:58:21.944255 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 07:58:21.944255 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: warnings.warn(msg) Aug 01 07:58:21.945470 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-4a03adbe-405a-42ae-a2d1-f9d89ac0ee4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:21.945916 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-4a03adbe-405a-42ae-a2d1-f9d89ac0ee4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:21.946705 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-4a03adbe-405a-42ae-a2d1-f9d89ac0ee4c admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:58:21.947134 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: DEBUG oslo_concurrency.lockutils [None req-4a03adbe-405a-42ae-a2d1-f9d89ac0ee4c admin admin] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:58:21.968510 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: INFO nova.api.openstack.requestlog [None req-4a03adbe-405a-42ae-a2d1-f9d89ac0ee4c admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078550 Aug 01 07:58:21.969056 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: [pid: 103523|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 07:58:21 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 07:59:17.377219 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: Mon Aug 1 07:59:17 2022 - graceful shutdown triggered... Aug 01 07:59:17.376958 dv-cinder-740146-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 07:59:17.378191 dv-cinder-740146-16-iscsi devstack@n-api.service[103522]: Gracefully killing worker 1 (pid: 103522)... Aug 01 07:59:17.378825 dv-cinder-740146-16-iscsi devstack@n-api.service[103523]: Gracefully killing worker 2 (pid: 103523)... Aug 01 07:59:18.377986 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: worker 1 buried after 1 seconds Aug 01 07:59:18.378595 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: worker 2 buried after 1 seconds Aug 01 07:59:18.378595 dv-cinder-740146-16-iscsi devstack@n-api.service[103521]: goodbye to uWSGI. Aug 01 07:59:18.379648 dv-cinder-740146-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 07:59:18.380198 dv-cinder-740146-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 07:59:18.382965 dv-cinder-740146-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 07:59:18.392320 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 07:59:18 2022] *** Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: nodename: dv-cinder-740146-16-iscsi Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: machine: x86_64 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: clock source: unix Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: pcre jit disabled Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: detected number of CPU cores: 4 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: current working directory: / Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: detected binary path: /usr/bin/uwsgi-core Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: your processes number limit is 47680 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: your memory page size is 4096 bytes Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: detected max file descriptor number: 2048 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: lock engine: pthread robust mutexes Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: thunder lock: enabled Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 07:59:18.395927 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 07:59:18.434731 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: Python main interpreter initialized at 0x55dcfd17a9c0 Aug 01 07:59:18.434731 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: python threads support enabled Aug 01 07:59:18.434731 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: your server socket listen backlog is limited to 100 connections Aug 01 07:59:18.434731 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: your mercy for graceful operations on workers is 90 seconds Aug 01 07:59:18.436172 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 07:59:18.436172 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: *** Operational MODE: preforking *** Aug 01 07:59:18.436172 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: *** uWSGI is running in multiple interpreter mode *** Aug 01 07:59:18.436172 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: spawned uWSGI master process (pid: 118222) Aug 01 07:59:18.435656 dv-cinder-740146-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 07:59:18.452015 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: spawned uWSGI worker 1 (pid: 118232, cores: 1) Aug 01 07:59:18.452015 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: spawned uWSGI worker 2 (pid: 118233, cores: 1) Aug 01 07:59:18.452015 dv-cinder-740146-16-iscsi devstack@n-api.service[118222]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 07:59:19.108453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:59:19.133769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 07:59:20.251216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:59:20.251216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: from cryptography.utils import int_from_bytes Aug 01 07:59:20.251823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:59:20.251823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: from cryptography.utils import int_from_bytes Aug 01 07:59:20.289079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:59:20.289079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: from cryptography.utils import int_from_bytes Aug 01 07:59:20.289749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 07:59:20.289749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: from cryptography.utils import int_from_bytes Aug 01 07:59:22.643502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:59:22.644145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:59:22.644434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:59:22.644684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:59:22.644940 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:59:22.645331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.646070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.646070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.646346 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.646598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.647102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.647623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.647962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.648284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.648542 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.648857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.649178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-16-iscsi {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.649498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.649990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.650304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.650633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.650936 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.651263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.651577 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.652088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.653588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.653588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.653588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.653588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.653953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.654035 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.654369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.654672 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.654992 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.655300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.655736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-16-iscsi {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.656065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.656380 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.656828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.657086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.657398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.657693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.658013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.658454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.658772 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.659121 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.659423 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.659776 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.660092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.660388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.660702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.661005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.661326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.661628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.661928 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.662168 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.662469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.662794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.663112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.663439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.663718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.663968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.664286 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.664609 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.664916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.665224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.665530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.665841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.666150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.666448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.666752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.667056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.667370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.667708 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.668034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.668341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.668658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.669062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.669312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.669619 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.669954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.670275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.670584 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.670898 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.671218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.671522 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.671855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.672161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.672474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.672894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.673110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.673354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.673654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.674504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.674822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.675126 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.675432 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.675760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.676060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.676369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.676673 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.677002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.677552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.677858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.678163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.678470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.678769 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.679068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.679385 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.679584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 07:59:22.680090 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.680251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 07:59:22.680437 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.680437 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.680738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 07:59:22.680901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.681064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 07:59:22.681249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.681418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 07:59:22.681573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.681725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.681885 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682215 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.682964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.683110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.683261 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.683637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.683827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.684220 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.684376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.684521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.684674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.684822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.684980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.685135 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.685378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.685641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.685801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-16-iscsi {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.685965 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.686122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.686277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.686277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.686572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.686720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.686878 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.687031 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.687188 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.687341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.687496 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.687701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.687864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.688029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.688176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.688330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.688330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.688704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.688882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.689036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.689188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.689985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.690144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.690385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.690547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.690699 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.690846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.690998 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.691152 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.691307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.691463 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.691663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.691812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.691966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.692128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.692287 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.692433 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.692589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.692744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.692744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.693037 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-16-iscsi {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.693182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.693334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.693500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.694702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.694875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.695032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.695188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.695363 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.695776 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.695947 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.696111 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.696267 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.696431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.696580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.696734 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.696888 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.697044 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.697239 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.697389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.697542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.697741 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.697920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.698080 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.698236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.698391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.698537 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.698701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.698934 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.699093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.699239 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.699384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.699555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.699719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.699877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.700042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.700749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.700911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.701059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.701212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.701366 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.701520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.701700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.702159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.702316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.702464 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.702675 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.702836 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.703000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.703000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.703297 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.703442 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.703642 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.704147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.704391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.704556 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.704900 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.705088 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.705237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.705396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.705542 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.705834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.706107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.706277 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.706427 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.706583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.706738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.706892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.707039 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.707194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.707366 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.707520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.707704 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.707905 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.708064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.708220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.708375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.708522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.708667 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.708819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.709064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.709225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.709382 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.709547 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.709703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.709856 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.710010 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.710156 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.710314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.710468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.710623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.710623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.710954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.711109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.711254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.711419 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.711600 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.711771 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.711920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.712082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.712229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.712381 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.712552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.712552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.713352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.713352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.713662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.713819 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.714226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.714400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.714621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.714621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.715096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.715248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.715402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.715569 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.715763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.716028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.716296 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.716456 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.716611 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.716777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.716939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.717093 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.717251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.717404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.717558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.717713 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.717914 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.718071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.718233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.718393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.718540 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.718693 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.718859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.719020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.719343 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.719591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.719750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.719908 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.720054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.720209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.720623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.720883 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.721038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.721183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.721350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.721580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.722040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.722209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.722368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.722531 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.722693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.722840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.723074 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.723231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.723394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.723561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.723715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.723872 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.724018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.724446 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.724627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.724862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.725034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.725361 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.725516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.725679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.725826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.725991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.726228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.726498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.726661 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.726817 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.726964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.727119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.727272 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.727425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.727624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.727801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.727949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.728140 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.728290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.728442 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.728598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.728755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.728901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.729046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.729200 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.729370 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.729601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.729752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.729897 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.730049 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.730203 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.730358 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.730513 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.730667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.730833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.730987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.731132 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.731278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.731442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.731605 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.731756 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.731910 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.732057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.732215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.732364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.732516 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.732683 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.732836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 07:59:22.732990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.733149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.733296 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.733441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.733594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.733747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.733893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.734047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.734194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.734194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.734720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.734901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.735123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.735306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.735636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.735796 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.735950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.736104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.736830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737023 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737425 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.737963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738343 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738435 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738527 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738620 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738706 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.738983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.739982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740325 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740509 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.740964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741242 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741421 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741512 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741689 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741782 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.741968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742138 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742230 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742808 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.742958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743029 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743121 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.743997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.744084 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.744176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745027 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745220 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745522 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.745987 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746067 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746307 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746691 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746776 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.746996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747239 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747390 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747736 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747886 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.747968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.748041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.748112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.748182 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.748259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.748331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.748410 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.749728 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.749845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.749924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750093 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750261 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750908 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.750988 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751148 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751289 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751368 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751768 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.751918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.752504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.752759 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.752850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.752943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753199 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753293 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753379 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753379 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.753885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754540 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754783 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.754946 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755097 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.755963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.756034 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.756300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.756406 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.756498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.756774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.756918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757724 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.757931 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.758138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.758257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.758380 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.758626 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.758785 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.758961 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.759085 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.759199 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.759320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.761618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.762350 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.762486 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.762632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.762758 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.762880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763317 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.763906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764873 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.764995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765317 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765687 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765772 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.765955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766049 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766385 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766811 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766903 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.766999 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767192 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767361 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767741 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.768169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.768310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.768486 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.768731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.768865 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.769078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.769184 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.769390 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.769494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.769704 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.769810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.770945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.771030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.771249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.771333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.771800 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.771943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772089 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.772887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.773117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.773212 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.773430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.773522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.773735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.773831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774039 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774134 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774346 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.774959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.775047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.775268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.775361 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.775617 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.775728 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.775928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776543 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776647 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.776941 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.777151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.777251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.777457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.777564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.777765 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.777858 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778166 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.778973 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.779067 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.779274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.779367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.779622 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.779718 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.779934 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780535 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780838 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.780938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.781180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.781281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.781482 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.781595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.781802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.781932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.782122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.782239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.782431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.782524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.782739 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.782842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.783082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.783255 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.783421 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.783524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.783737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.783849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784041 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784764 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.784974 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.785988 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.786204 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.786302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.786510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.786610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.786823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.786913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.787141 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.787222 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.787463 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.787749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.787844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.788086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.788177 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.788393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.788501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.788700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.788793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.789943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790358 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790553 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.790964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.791165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.791259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.791469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.791621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.791814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.791921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.792183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.792294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.792414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.792545 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.792720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.792823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.793932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794338 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794545 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794855 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.794975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.795169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.795266 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.795477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.795602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.795827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.795923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.796139 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.796224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.796446 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.796546 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.796751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.796845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.797056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.797160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.797402 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.797495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.797710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.797802 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.798054 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.798156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.798370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.798470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.799237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.799404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.799566 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.799659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.799830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.799948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.800151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.800284 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.800456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.800595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.800760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.800904 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.801065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.801220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.801387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.801535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.801695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.801851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.802016 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.802162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.802704 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.802808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803098 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.803968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.804062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.804282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.804377 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.804590 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.804690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.804907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.805005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.805220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.805310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.805527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.805622 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.805862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.806070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.806177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.806480 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.806600 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.806807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.806924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.807117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.807220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.807429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.807559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.807758 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.807850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.808086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.808250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.808402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.808525 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.808715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.808838 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.809036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.809151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.809448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.809542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.809766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.809866 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.810075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.810171 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.810391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.810496 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.810704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.810814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811757 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.811947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812811 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812903 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.812987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.813159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.813252 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.813468 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.813570 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.813773 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.813866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.814076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.814176 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.815021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.815167 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.815603 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.815710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.815927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.816087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.816254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.816409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.816572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.816728 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.816905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.817042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.817231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.817359 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.817538 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.817675 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.817862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818170 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818643 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.818956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.819082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.819268 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.819423 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.819649 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.819747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.819964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.820066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.820330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.820431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.820643 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.820736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.820969 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.821063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.821293 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.821388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.821622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.821718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.821925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822025 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822345 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.822972 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.823160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.823262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.823469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.823612 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.823800 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.823893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.824104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.824204 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.824406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.824508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.824715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.824819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825015 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.825947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826351 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.826991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.827185 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.827279 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.827487 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.827624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.827817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.827926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.828142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.828242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.828451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.828550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.828766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.828861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.829084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.829178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.829401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.829501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.829712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.829806 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.830064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.830201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.830375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.830575 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.830682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.830780 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831008 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831423 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.831968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.832103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.832278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.832498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.832591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.832677 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.832984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.833100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.833189 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.833501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.833595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.833818 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.833911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.834136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.834376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.834484 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.834712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.834808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.835032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.835125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.835350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.835451 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.835690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.835796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836430 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836746 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.836964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.837066 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.837275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.837377 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.837590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.837693 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.837920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838232 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.838972 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.839173 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.839269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.839482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.839624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.839833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.840142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.840431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.840526 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.840759 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.840881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.841125 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.841233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.841447 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.841548 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.841757 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.841901 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.842074 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.842211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.842395 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.842538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.842713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.842831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843046 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843177 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843343 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843787 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.843996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.844092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.844308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.844408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.844621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.844721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.844934 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.845030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.845246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.845384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.845624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.845827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846028 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846351 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.846926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.847028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.847243 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.847338 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.847755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.847868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.848086 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.848225 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.848403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.848525 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.848729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.848833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.849994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.850088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.850302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.850411 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.850610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.850747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.850925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851566 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851675 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.851965 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.852198 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.852337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.852505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.852639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.852812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.852906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.853122 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.853225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.853435 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.853657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.853761 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854649 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854750 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.854974 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.855068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.855293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.855388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.855622 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.855720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.855933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856666 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.856974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.857179 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.857274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.857482 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.857583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.857786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.857890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.858096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.858190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.858403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.858503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.858707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.858813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.859977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860081 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860680 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860897 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.860989 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.861752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.861892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862019 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862133 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862382 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.862988 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.863122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.863217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.863432 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.863598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.863765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.863861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.864093 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.864186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.864403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.864505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.864729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.864833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865756 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.865961 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.866100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.866276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.866416 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.866601 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.866695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.866938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.867031 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.867256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.867358 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.867601 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.867747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.867933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.868062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.868245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.868353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.868572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.868782 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.868875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.869117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.869217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.869438 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.869541 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.869772 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.869866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.870103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.870205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.870411 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.870505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.870718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.870820 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871342 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871786 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.871994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.872102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.872305 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.872540 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.872646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.872870 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.872964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.873190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.873293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.873504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.873642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.873812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.873918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.874121 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.874223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.874428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.874522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.874735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.874878 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875680 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.875995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.876098 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.876321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.876424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.876649 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.876749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.877581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.877684 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.877901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.878030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.878222 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.878356 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.878532 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.878680 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.878842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.879017 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.879152 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.879365 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.879467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.879711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.879807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.880981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.881104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.881301 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.881403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.881616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.881711 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.881932 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882247 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.882980 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.883200 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.883309 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.883514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.883643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.883860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.883958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.884189 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.884281 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.884513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.884621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.884829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.884923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.885144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.885239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.885451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.885588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.885757 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.885976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.886074 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.886297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.886441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.886635 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.886729 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.886956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.887049 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.887259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.887398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.887590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.887702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.887901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888507 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.888910 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.889111 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.889204 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.889416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.889510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.889717 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.889818 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890324 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.890929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.891023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.891230 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.891331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.891574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.891859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.891964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.892162 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.892264 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.892518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.892647 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.892814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.893849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.894070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.894166 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.894392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.894494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.894700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.894808 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895118 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895324 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.895965 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896374 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896894 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.896996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.897209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.897311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.897519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.897614 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.897826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.897918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.898131 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.898233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.898438 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.898538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.898742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.898834 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.899057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.899152 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.899364 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.899459 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.899695 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.899791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900007 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900731 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.900939 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901387 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901556 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901651 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.901966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.902179 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.902280 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.902490 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.902592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.902802 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.902911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.903114 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.903227 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.903429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.903559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.903764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.903860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.904076 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.904208 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.904391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.904499 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.904704 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.904797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905758 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.905990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.906091 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.906314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.906557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.906696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.906895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.906990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.907220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.907325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.907577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.907676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.907916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.908009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.908365 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.908481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.908681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.908925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.909026 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:59:22.909323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.909656 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.909976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.910292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.910608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.910925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.911248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.911586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.911905 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.912220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.912532 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.912844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.913203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.913465 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.913777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.914088 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.914406 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.914750 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.915073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.915392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.915737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.916057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.916370 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.916682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.916991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.917300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.917617 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.917950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.918266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.918572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.918995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.919309 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.919654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.919980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.920294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.920619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.920944 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.921262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.921586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.921899 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.922228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.922569 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.922903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.923246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.923576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.924457 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.924692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.925005 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.925326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.925637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.925944 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.926250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.926563 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.926869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.927419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.927757 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.928064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.928375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.928679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.928984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.929290 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.929595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.929900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.930206 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.930594 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.930910 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.931218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.931560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.931856 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.932163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.932497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.932833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.933152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.933486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.933800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.934125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.934437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.934764 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.935088 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.935404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.935741 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.936076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.936391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.936701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.937017 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.937328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.937641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.937953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.938282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.938610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.938921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.939248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.940207 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.940533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.940851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.941165 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.941499 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.941818 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.942132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.942444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.942756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.943070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.943388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.943726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.944037 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.944356 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.944673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.945006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.945334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.945649 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.945979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.946307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.946655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.947033 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.947314 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.947667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.947986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.948301 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.948609 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 07:59:22.948853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 07:59:22.970208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO dbcounter [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Registered counter for database nova_api Aug 01 07:59:22.991422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_db.sqlalchemy.engines [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:22.999599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writer thread running {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.010472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO dbcounter [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Registered counter for database nova_api Aug 01 07:59:23.030555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_db.sqlalchemy.engines [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.037936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writer thread running {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.055996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.context [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7e949bb-6181-44eb-9611-dda4f19e218a(cell1) {{(pid=118233) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:59:23.060100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:59:23.061714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:59:23.062502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:59:23.064587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:59:23.066530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO dbcounter [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Registered counter for database nova_cell0 Aug 01 07:59:23.070533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO dbcounter [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Registered counter for database nova_cell1 Aug 01 07:59:23.078070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_db.sqlalchemy.engines [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.079376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_db.sqlalchemy.engines [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.086173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writer thread running {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.087549 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writer thread running {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.094436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.context [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a7e949bb-6181-44eb-9611-dda4f19e218a(cell1) {{(pid=118232) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 07:59:23.099180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:59:23.100801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:59:23.101586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 07:59:23.103605 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 07:59:23.105592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO dbcounter [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Registered counter for database nova_cell0 Aug 01 07:59:23.109625 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO dbcounter [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Registered counter for database nova_cell1 Aug 01 07:59:23.117679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_db.sqlalchemy.engines [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.119899 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_db.sqlalchemy.engines [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.124953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writer thread running {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.127659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writer thread running {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.238670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO dbcounter [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Registered counter for database nova_cell0 Aug 01 07:59:23.245318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_db.sqlalchemy.engines [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.250238 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writer thread running {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.274549 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO dbcounter [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Registered counter for database nova_cell0 Aug 01 07:59:23.281128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_db.sqlalchemy.engines [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 07:59:23.287339 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writer thread running {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 07:59:23.574544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: WARNING keystonemiddleware.auth_token [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:59:23.582621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: WARNING keystonemiddleware.auth_token [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:59:23.604774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: WARNING keystonemiddleware.auth_token [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:59:23.613182 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: WARNING keystonemiddleware.auth_token [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:59:23.941850 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: WARNING keystonemiddleware.auth_token [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:59:23.948584 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: WARNING keystonemiddleware.auth_token [None req-db249c67-010a-4e03-84e6-b9703838ef9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:59:23.954134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dcfd17a9c0 pid: 118233 (default app) Aug 01 07:59:23.963833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: WARNING keystonemiddleware.auth_token [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 07:59:23.969789 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: WARNING keystonemiddleware.auth_token [None req-177eab50-7d6b-4c9d-8ab8-a547c83c2913 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 07:59:23.975807 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55dcfd17a9c0 pid: 118232 (default app) Aug 01 08:00:10.331814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:10.342727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:10.342727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:10.342727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:10.794062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dd61d205-5995-4b83-afed-f3d227bbf800 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe45438a60>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:11.788058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dd61d205-5995-4b83-afed-f3d227bbf800 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/36c63eed-9bbf-460f-81a3-f36d76e84882" status: 200 len: 350 microversion: 2.1 time: 1.470602 Aug 01 08:00:11.796500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:00:10 2022] GET /compute/v2.1/os-volumes/36c63eed-9bbf-460f-81a3-f36d76e84882 => generated 350 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:15.386911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:15.393438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:15.393438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:15.393438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:15.921474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-03bba3df-7a6e-433f-a0f6-492060093c85 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe454b3c10>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:17.652471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-03bba3df-7a6e-433f-a0f6-492060093c85 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ff2675ea-1ce0-4e20-bb50-16380bdfdf20" status: 200 len: 350 microversion: 2.1 time: 2.270774 Aug 01 08:00:17.660843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:00:15 2022] GET /compute/v2.1/os-volumes/ff2675ea-1ce0-4e20-bb50-16380bdfdf20 => generated 350 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:20.974775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-732ee20a-ea17-457a-9a7e-b70c0281cf61 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe452f8d30>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:21.344341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9afd3fc6-8523-4856-84a0-5c8d0e67e15b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: .version_select at 0x7efe452fdaf0>, body: {"keypair": {"name": "tempest-keypair-938853357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYSVRO5fGzlTRUqMCDQGtxLlaQu83FgDj0iyx3iOvHCWRfCRYv/eoJjgte8rkyf9jhQgm9ZbqRn74Kr3NiC1pRfb0l9iXcc3y+kpm+lLChCEpDUQY5froTOr5KJ3ExMYg=="}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:21.498454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-9afd3fc6-8523-4856-84a0-5c8d0e67e15b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:21.509304 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-732ee20a-ea17-457a-9a7e-b70c0281cf61 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/136d975b-9aff-4b2d-ab7a-2e2f06a5d071" status: 200 len: 351 microversion: 2.1 time: 0.539765 Aug 01 08:00:21.517913 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:00:20 2022] GET /compute/v2.1/os-volumes/136d975b-9aff-4b2d-ab7a-2e2f06a5d071 => generated 351 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:21.526505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-493b7aab-364a-47e8-95d8-9e5b0bd657e8 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe452b5430>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:21.541399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-9afd3fc6-8523-4856-84a0-5c8d0e67e15b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:21.757402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9afd3fc6-8523-4856-84a0-5c8d0e67e15b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.231828 Aug 01 08:00:21.758326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 2/4] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:00:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:22.177874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-493b7aab-364a-47e8-95d8-9e5b0bd657e8 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.657128 Aug 01 08:00:22.178443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 1 08:00:21 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:22.193887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3553e6ff-8450-426b-94c3-4b090579ed38 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe452a0a60>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:22.617120 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3553e6ff-8450-426b-94c3-4b090579ed38 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.427498 Aug 01 08:00:22.618356 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 3/6] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Aug 1 08:00:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:22.634408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-44a13dc6-372a-4d56-b6aa-3733ceb6766d tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe452f8c10>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:22.967966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-44a13dc6-372a-4d56-b6aa-3733ceb6766d tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.339054 Aug 01 08:00:22.968261 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 1 08:00:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:22.983226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e4b0ba16-9aef-480a-a071-f3f7e238d3ea tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe452bcd30>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:23.349766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b83ab095-8ac9-4c7d-b1b6-302e6fbc6bdd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: .version_select at 0x7efe44a68310>, body: {"keypair": {"name": "tempest-keypair-723233961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9izxb5OuMp44n9UCY0pLHXwfWyf2bsp+f29FSExeP4JSAwmu20ruX+N2b21Piei9hfuqVamtKz8gJtrQyCByygIugrUw0t+P3gFZ/AvQWkZliPpdTR3IP1wqELQmflRA=="}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:23.418066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-b83ab095-8ac9-4c7d-b1b6-302e6fbc6bdd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:23.436231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-b83ab095-8ac9-4c7d-b1b6-302e6fbc6bdd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for user f030155981d741f1a42b9b84ca5d6af4 and project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:23.526975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e4b0ba16-9aef-480a-a071-f3f7e238d3ea tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.547044 Aug 01 08:00:23.538154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Aug 1 08:00:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:23.620855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b83ab095-8ac9-4c7d-b1b6-302e6fbc6bdd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.916835 Aug 01 08:00:23.627810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 4/9] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:00:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:00:23.654665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-96be93dc-4e22-4eb5-b64f-10423d68ffbc tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe44a68430>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:23.751398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1448422901", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:23.964674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-96be93dc-4e22-4eb5-b64f-10423d68ffbc tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.335645 Aug 01 08:00:23.966623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 5/10] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Aug 1 08:00:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:23.981697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3646f54c-adff-44bf-b7bb-25688dbeb9b9 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe44a631f0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:24.040203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] validate_networks() for [('aefda8bc-e850-4f20-b2fd-fcc55caeafbf', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:00:24.175339 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3646f54c-adff-44bf-b7bb-25688dbeb9b9 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.199863 Aug 01 08:00:24.175944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 6/11] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 1 08:00:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:24.189489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f65e5011-2c7e-457c-ab55-224c2914501c tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe44a6a9d0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:24.471638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f65e5011-2c7e-457c-ab55-224c2914501c tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.279690 Aug 01 08:00:24.471638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Aug 1 08:00:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:00:24.483066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-27398a79-cb99-4a23-859b-87cf1019def5 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] Calling method '.version_select at 0x7efe44a63a60>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:24.780521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-27398a79-cb99-4a23-859b-87cf1019def5 tempest-VolumesTestJSON-829099920 tempest-VolumesTestJSON-829099920-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.301250 Aug 01 08:00:24.795809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 1 08:00:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:25.206333 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1234738689", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "networks": [{"uuid": "00a51e7f-07fe-4a74-b5dc-95bb523f8ac3"}]}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:25.448181 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] validate_networks() for [('00a51e7f-07fe-4a74-b5dc-95bb523f8ac3', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:00:26.681658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:00:26.687744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:00:26.687744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:00:26.687744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:00:26.687744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:00:26.705737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:26.707585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:26.708630 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:26.711416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:26.740535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:00:26.741073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:00:26.741813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:00:26.742095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:00:26.742894 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:00:26.776123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:26.777550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:26.781865 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:26.788719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:26.797846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Getting quotas for project 768f11935fcd4080b5045613f6b7cb28. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:26.819451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Getting quotas for user 570de5da908c4b31a8a22706642aafb4 and project 768f11935fcd4080b5045613f6b7cb28. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:26.836843 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:00:26.849245 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:00:26.863875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:26.879549 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for user 972bc4e9bc9e49b4a3bc2a693b05e4ab and project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:26.908288 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:00:26.911151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:00:27.144577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ef8993b3-b654-484a-9093-c73bd28a05db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.600168 Aug 01 08:00:27.152058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 6/14] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:00:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 3613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:00:27.169600 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b4e55b20-5fb0-4ad7-bb9b-0372f6face3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:27.176448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7070838b-5e92-43d8-87ac-7de2f061f8a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354637 Aug 01 08:00:27.179842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 9/15] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:00:27.184797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b4e55b20-5fb0-4ad7-bb9b-0372f6face3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:27.190294 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-acf48405-2ebb-4e90-820d-1d6f55798072 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:27.193868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-acf48405-2ebb-4e90-820d-1d6f55798072 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:27.405050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b4e55b20-5fb0-4ad7-bb9b-0372f6face3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:27.438503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b4e55b20-5fb0-4ad7-bb9b-0372f6face3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1222 microversion: 2.1 time: 0.282748 Aug 01 08:00:27.457699 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 7/16] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:27 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:27.469645 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-acf48405-2ebb-4e90-820d-1d6f55798072 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:27.501300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-acf48405-2ebb-4e90-820d-1d6f55798072 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1215 microversion: 2.1 time: 0.315524 Aug 01 08:00:27.503260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 10/17] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:27 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:27.725724 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1808427046", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:27.813128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] validate_networks() for [('aefda8bc-e850-4f20-b2fd-fcc55caeafbf', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:00:28.532067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fd1b5f57-dc09-44ff-b6f3-614d7353bb7c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:28.534718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fd1b5f57-dc09-44ff-b6f3-614d7353bb7c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:28.723039 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fd1b5f57-dc09-44ff-b6f3-614d7353bb7c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:28.727295 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fd1b5f57-dc09-44ff-b6f3-614d7353bb7c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1215 microversion: 2.1 time: 0.205425 Aug 01 08:00:28.727921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 11/18] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:28 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:29.601193 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-376597821", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1c12be1-af6a-4cc8-84b7-bc9366e80977"}], "security_groups": [{"name": "tempest-securitygroup--705516366"}], "key_name": "tempest-keypair-938853357", "user_data": "}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:29.642520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:00:29.643028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:00:29.643786 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:00:29.644296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:00:29.644806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:00:29.673341 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:29.674486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:29.676044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:29.677841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:29.794385 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] validate_networks() for [('c1c12be1-af6a-4cc8-84b7-bc9366e80977', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:00:29.800315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:29.825929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for user 972bc4e9bc9e49b4a3bc2a693b05e4ab and project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:29.867863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:00:29.872109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:00:30.071859 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1def1bee-1e52-459f-a191-87dd343cbe57 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.351061 Aug 01 08:00:30.083514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 8/19] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:00:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:00:30.097803 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d250fb30-f120-41ac-b2a7-958895097ff6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:30.098432 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d250fb30-f120-41ac-b2a7-958895097ff6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:30.279949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d250fb30-f120-41ac-b2a7-958895097ff6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:30.286994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d250fb30-f120-41ac-b2a7-958895097ff6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1215 microversion: 2.1 time: 0.202062 Aug 01 08:00:30.288090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 9/20] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:30 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:30.322722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-91938d50-07a0-490c-8a4a-4aaeff5a50c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:30.322722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-91938d50-07a0-490c-8a4a-4aaeff5a50c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:30.416877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-91938d50-07a0-490c-8a4a-4aaeff5a50c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:30.428552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-91938d50-07a0-490c-8a4a-4aaeff5a50c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1222 microversion: 2.1 time: 0.124008 Aug 01 08:00:30.432588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 10/21] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:30 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:30.655807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:00:30.656349 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:00:30.656841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:00:30.657325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:00:30.657809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:00:30.670308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:30.670764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:30.674395 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:30.675086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:30.704682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:30.709345 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:30.723216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:00:30.728732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:00:30.885819 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e8c15a5e-80da-403d-9619-34f6a52a51f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.289839 Aug 01 08:00:30.887150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 12/22] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:00:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:00:30.900328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9b3089ee-a97d-463e-9b59-c89c8145b5a8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:30.901729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9b3089ee-a97d-463e-9b59-c89c8145b5a8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:31.013101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9b3089ee-a97d-463e-9b59-c89c8145b5a8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:31.079763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9b3089ee-a97d-463e-9b59-c89c8145b5a8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1240 microversion: 2.1 time: 0.175691 Aug 01 08:00:31.079763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:30 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1240 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:31.310596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:31.311220 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:31.329765 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:31.334063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:31.340720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:31.342079 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:31.456846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:31.457433 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:31.469563 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:31.476893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:31.478201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:31.479129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:31.728279 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:31.755466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3db6c233-1917-4f54-be7c-b399e69d49da tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1226 microversion: 2.1 time: 0.298515 Aug 01 08:00:31.761355 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 12/24] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:31 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1226 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:31.768489 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-192782679", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43709bde-c530-4a06-9050-7c287d9a00eb"}], "security_groups": [{"name": "tempest-securitygroup--613584129"}], "key_name": "tempest-keypair-723233961", "user_data": "}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:31.811944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:31.830279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-41b5c3bd-2ddb-4b43-8a7f-2972e8b62169 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1267 microversion: 2.1 time: 0.524004 Aug 01 08:00:31.849641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:31 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1267 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:31.981009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] validate_networks() for [('43709bde-c530-4a06-9050-7c287d9a00eb', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:00:32.101960 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5cf9c7be-7d4f-4f4e-8129-be9e8397ec8e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:32.102585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5cf9c7be-7d4f-4f4e-8129-be9e8397ec8e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:32.241261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5cf9c7be-7d4f-4f4e-8129-be9e8397ec8e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:32.256849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5cf9c7be-7d4f-4f4e-8129-be9e8397ec8e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1240 microversion: 2.1 time: 0.159216 Aug 01 08:00:32.260008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:32 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1240 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:32.718906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:00:32.719819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:00:32.720330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:00:32.721001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:00:32.721608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:00:32.741522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:32.742272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:32.743259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:32.744095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:32.767770 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:00:32.776524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for user f030155981d741f1a42b9b84ca5d6af4 and project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:00:32.780957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:32.781587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:32.801990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:32.811392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:00:32.812316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:32.815898 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:32.816628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:32.821733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:00:32.921061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:32.931001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9bb485c7-a3f9-4619-809e-83e32bb6d69b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1274 microversion: 2.1 time: 0.155030 Aug 01 08:00:32.932139 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:32 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1274 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:32.937315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:32.938236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:32.956650 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:32.957645 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:32.959324 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:32.961110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:33.061474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ea0fec40-2d9c-4bcf-a834-81aefa956b64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.294289 Aug 01 08:00:33.062307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 13/28] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:00:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:00:33.082132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b0819975-366c-412a-884f-e08c8c400633 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:33.099877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b0819975-366c-412a-884f-e08c8c400633 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:33.441290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:33.471682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f634de67-5eeb-481a-a817-31c4448ef1d6 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1275 microversion: 2.1 time: 0.535776 Aug 01 08:00:33.486274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 16/29] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:32 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1275 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:33.504596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:33.504596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:33.510802 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:33.511817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:33.513158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:33.513602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:33.526185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b0819975-366c-412a-884f-e08c8c400633 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:33.542290 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b0819975-366c-412a-884f-e08c8c400633 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1236 microversion: 2.1 time: 0.467434 Aug 01 08:00:33.545534 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:33 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1236 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:33.731741 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:33.741599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2f876c0f-09ad-4cdd-86ca-45386e2f542f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1292 microversion: 2.1 time: 0.263432 Aug 01 08:00:33.742188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:33 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:33.958432 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:33.959142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:33.975417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:33.977152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:33.979639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:33.981926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:34.428297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:34.441110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6a125c79-33dc-4085-a083-0d2014be3ed9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1292 microversion: 2.1 time: 0.487441 Aug 01 08:00:34.457057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 15/32] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:33 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1292 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:34.495935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:34.496736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:34.530803 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:34.531318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:34.535237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:34.536063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:34.575437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a6d6b755-94eb-4d31-a0f0-37f96fe7387d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:34.576329 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a6d6b755-94eb-4d31-a0f0-37f96fe7387d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:34.773797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:34.806807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e41de300-321d-477c-8f83-7a00fc2e020a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1273 microversion: 2.1 time: 0.302410 Aug 01 08:00:34.807485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 18/33] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:34 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:34.824480 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:34.825150 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a6d6b755-94eb-4d31-a0f0-37f96fe7387d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:34.826588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:34.837486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a6d6b755-94eb-4d31-a0f0-37f96fe7387d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1236 microversion: 2.1 time: 0.274758 Aug 01 08:00:34.839775 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:34.841522 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:34.842332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:34.842781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:34.857397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 16/34] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:34 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1236 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:35.025616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:35.030041 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a3aff215-807a-4abc-9a7f-561f0fdc58a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1310 microversion: 2.1 time: 0.217784 Aug 01 08:00:35.031829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 19/35] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:34 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1310 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:35.470276 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:35.471632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:35.495418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:35.510008 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:35.513817 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:35.516956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:35.830910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:35.832117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:35.842041 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:35.842506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:35.843396 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:35.843984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:36.032984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:36.045179 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fe68db38-b07e-4090-a64e-e1e5aa916d4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1280 microversion: 2.1 time: 0.579350 Aug 01 08:00:36.046032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 17/36] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:35 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1280 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:36.056869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:36.057418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:36.075412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:36.075902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:36.076701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:36.077246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:36.317820 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:36.335242 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8221d409-2d17-4d87-bcbd-8dd90ab74a95 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1288 microversion: 2.1 time: 0.287455 Aug 01 08:00:36.336473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:36 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1288 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:36.343439 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:36.344715 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:36.356609 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:36.357630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:36.359316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:36.360638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:36.567943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:36.578614 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-63a4280f-db84-474f-bcb4-ad7b5f1decd2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1298 microversion: 2.1 time: 0.236252 Aug 01 08:00:36.591776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:36 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1298 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:37.080047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:37.080047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:37.080047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:37.080047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:37.080488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:37.098820 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:37.121054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:37.141874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-859ea08c-7906-4fb7-bf7c-023ee49704f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 1.308522 Aug 01 08:00:37.142637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 20/39] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:35 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:37.359887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:37.360760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:37.373783 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:37.377003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:37.377882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:37.378496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:37.841093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:37.851797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9b46f4c0-ff50-4954-9273-adc9c5fb4348 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1288 microversion: 2.1 time: 0.497628 Aug 01 08:00:37.871937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:37 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1288 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:37.886187 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:37.896376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:37.910318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:37.910683 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:37.911482 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:37.912041 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:38.058506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:38.067559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-26f58e3c-bf2e-4fd2-91a1-aaccdfef3c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 1.001678 Aug 01 08:00:38.083585 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 20/41] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:37 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:38.165529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:38.169424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:38.170050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:38.185296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:38.186049 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:38.187563 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:38.188147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:38.191858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6e448e27-7f16-4193-a207-79e1d0cb56eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1298 microversion: 2.1 time: 0.314759 Aug 01 08:00:38.201709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:37 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1298 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:38.873971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:38.874988 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:38.891318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:38.892003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:38.892955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:38.893749 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:39.061307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:39.071074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e46bd9ca-083c-4cc0-8f8a-6b9e8372eb6e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.906391 Aug 01 08:00:39.092196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:38 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:39.103147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:39.103948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:39.130748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:39.135447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:39.142362 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:39.142898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:39.470333 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:39.482238 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4db4784c-ce1e-48aa-b9f8-a4b9db3f7a01 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1294 microversion: 2.1 time: 0.613334 Aug 01 08:00:39.482836 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 23/44] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:38 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1294 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:39.487497 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:39.499454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:39.535791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:39.535791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:39.535791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:39.535791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.378265 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:40.393229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ab4b5d7a-cbda-4d55-89be-28ecb7397183 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 1.294173 Aug 01 08:00:40.396428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 22/45] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:39 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:40.408275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:40.413695 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:40.425814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.426630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.427676 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.428311 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.485317 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:40.494878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d8f3db0b-8ebb-4d6c-999d-539a142056d6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 1.010927 Aug 01 08:00:40.505257 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 24/46] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:39 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:40.641562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-2d76f609-cae4-4b3c-a592-940cd97e0c8a req-75ec1cb2-826d-417e-be0b-1285a53c655f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb98b62-cfe8-45eb-95c6-c705fccab622", "tag": "2d0b2d0a-db6a-41b3-b644-b06af8787bc8"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:40.680318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-2d76f609-cae4-4b3c-a592-940cd97e0c8a req-75ec1cb2-826d-417e-be0b-1285a53c655f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.681289 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-2d76f609-cae4-4b3c-a592-940cd97e0c8a req-75ec1cb2-826d-417e-be0b-1285a53c655f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.709656 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=4 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:40.724578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-2d76f609-cae4-4b3c-a592-940cd97e0c8a req-75ec1cb2-826d-417e-be0b-1285a53c655f service nova] Creating event network-changed:2d0b2d0a-db6a-41b3-b644-b06af8787bc8 for instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 on hv-cinder-74014 Aug 01 08:00:40.728707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-2d76f609-cae4-4b3c-a592-940cd97e0c8a req-75ec1cb2-826d-417e-be0b-1285a53c655f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 08:00:40.730242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.731247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.733161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.735779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.745135 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.compute.rpcapi [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 08:00:40.746533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] Releasing lock "compute-rpcapi-router" {{(pid=118233) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 08:00:40.796589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ba8012ad-61b2-4349-98c3-ab8e158a4980 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291597 Aug 01 08:00:40.798191 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 25/47] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:40.804063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:40.805541 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:40.813420 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.814147 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.815735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:40.816580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:40.998580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:41.009713 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f18fc5c9-1a99-43ca-8711-e9180b14ce87 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.611924 Aug 01 08:00:41.010598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:40 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:41.426920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:41.427609 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:41.438670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:41.444451 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:41.445642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:41.446244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:42.064374 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:42.084000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5fc651d4-d7c3-4b1c-afad-3dc319b14191 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.661295 Aug 01 08:00:42.084591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 24/49] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:41 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:42.119973 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:42.134368 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:42.136132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:42.140782 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b8361fd4-9fe4-4481-bdd1-a67e7ff98440 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 1.335130 Aug 01 08:00:42.150477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:42.153389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:42.155123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:42.155801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:42.167129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 26/50] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:40 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:42.173058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:42.173691 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:42.188040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:42.209254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:42.209254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:42.209254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:42.209254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:42.246832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=26 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:42.755228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=6 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:43.109385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:43.130208 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f82f8ac5-292f-42a1-9d43-67d900751c40 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 1.025854 Aug 01 08:00:43.132071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 25/51] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:42 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:43.259212 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-4cbfbc8d-58be-471e-9221-99814da0977b req-ada1a83f-ed25-4daa-a7ac-9928155cab62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90208b0f-9714-4c0b-8a4d-65014a5fbe42", "tag": "2a5cb53b-f343-4566-ae09-a9b80633224a"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:43.296259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4cbfbc8d-58be-471e-9221-99814da0977b req-ada1a83f-ed25-4daa-a7ac-9928155cab62 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.300251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4cbfbc8d-58be-471e-9221-99814da0977b req-ada1a83f-ed25-4daa-a7ac-9928155cab62 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.370190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-4cbfbc8d-58be-471e-9221-99814da0977b req-ada1a83f-ed25-4daa-a7ac-9928155cab62 service nova] Creating event network-changed:2a5cb53b-f343-4566-ae09-a9b80633224a for instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 on hv-cinder-74014 Aug 01 08:00:43.370778 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4cbfbc8d-58be-471e-9221-99814da0977b req-ada1a83f-ed25-4daa-a7ac-9928155cab62 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 08:00:43.372498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.372953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.373753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.374190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.401976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.compute.rpcapi [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 08:00:43.406157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] Releasing lock "compute-rpcapi-router" {{(pid=118232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 08:00:43.445874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-18c0a6b7-2559-4f10-b347-ad3a46430751 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.308650 Aug 01 08:00:43.446837 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 26/52] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:43.453419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-dd6095eb-b1fa-47d6-a92f-35cd9216583c req-9ee1dc42-7dd2-4f6f-9966-d86d5231148f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88215f9b-01f1-4d7a-8ab7-6f7d59a91da2", "tag": "3f8c2167-1c04-439c-83cb-a7061150f73e"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:43.460678 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:43.467519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-dd6095eb-b1fa-47d6-a92f-35cd9216583c req-9ee1dc42-7dd2-4f6f-9966-d86d5231148f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.468206 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-dd6095eb-b1fa-47d6-a92f-35cd9216583c req-9ee1dc42-7dd2-4f6f-9966-d86d5231148f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.514198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:43.522349 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6472ab74-f55a-4189-90c4-fec6e4e52c8a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 1.353302 Aug 01 08:00:43.522935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 27/53] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:42 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:43.525575 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-dd6095eb-b1fa-47d6-a92f-35cd9216583c req-9ee1dc42-7dd2-4f6f-9966-d86d5231148f service nova] Creating event network-changed:3f8c2167-1c04-439c-83cb-a7061150f73e for instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 on hv-cinder-74014 Aug 01 08:00:43.541529 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-dd6095eb-b1fa-47d6-a92f-35cd9216583c req-9ee1dc42-7dd2-4f6f-9966-d86d5231148f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091631 Aug 01 08:00:43.547121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:43.560075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:43.564173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:43.564357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:43.572429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:43.586237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.587231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.591329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.607771 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.621475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.627960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:43.628968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:43.629974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:44.072139 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:44.089887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4de4a6a2-1cd5-4633-b143-29716a12b6f3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.540999 Aug 01 08:00:44.092474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 28/55] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:43 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:44.156851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:44.160898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:44.175237 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:44.177039 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:44.180714 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:44.181404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:44.536617 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:44.548226 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-decb8beb-3768-4972-8d65-264c5cdb1968 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 1.023937 Aug 01 08:00:44.549995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 28/56] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:43 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:44.561621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:44.568462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:44.583504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:44.585530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:44.585530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:44.585957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:44.801441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:44.818353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a1ad07cb-a518-455b-b267-490ff93117d2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.664024 Aug 01 08:00:44.837936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 29/57] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:44 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:45.111191 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:45.112991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:45.116424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=30 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:45.120559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.121871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:45.123121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.123854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:45.157753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:45.192572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3b413aca-c18e-415e-be5f-e16a75795706 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.639259 Aug 01 08:00:45.198247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 29/58] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:44 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:45.420258 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:45.428671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-eaec088d-69f3-474a-94ec-705169bb17b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.321389 Aug 01 08:00:45.442476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:45 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:45.524779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-b43a0bf8-ab77-4c65-8709-20b60832435b req-c2442fee-c28d-43b7-aa71-9e724786b0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518e1fe8-c4a4-4e72-9984-324ab59f6683", "tag": "08766321-ade9-4163-8a76-f1980b912511"}, {"name": "network-changed", "server_uuid": "6f414074-c855-47d5-b2f8-ed5bb4b20b50", "tag": "9fa8b862-e443-4998-b915-92bdaff39190"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:00:45.536078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-b43a0bf8-ab77-4c65-8709-20b60832435b req-c2442fee-c28d-43b7-aa71-9e724786b0c7 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.536528 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-b43a0bf8-ab77-4c65-8709-20b60832435b req-c2442fee-c28d-43b7-aa71-9e724786b0c7 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:45.540343 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:45.553235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-b43a0bf8-ab77-4c65-8709-20b60832435b req-c2442fee-c28d-43b7-aa71-9e724786b0c7 service nova] Creating event network-changed:08766321-ade9-4163-8a76-f1980b912511 for instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 on hv-cinder-74014 Aug 01 08:00:45.553772 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-b43a0bf8-ab77-4c65-8709-20b60832435b req-c2442fee-c28d-43b7-aa71-9e724786b0c7 service nova] Creating event network-changed:9fa8b862-e443-4998-b915-92bdaff39190 for instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 on hv-cinder-74014 Aug 01 08:00:45.560904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-b43a0bf8-ab77-4c65-8709-20b60832435b req-c2442fee-c28d-43b7-aa71-9e724786b0c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039855 Aug 01 08:00:45.562293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:00:45.574215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:45.574828 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:45.581024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.581475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:45.582244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.582682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:45.601877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:45.820381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:45.828683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a6d50571-257b-41d3-a22b-cb1b1fc4dced tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.258336 Aug 01 08:00:45.829336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 31/61] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:45 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:45.846037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:45.847024 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:45.853198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.853653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:45.854426 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:45.854929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:46.005025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:46.013458 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7eb5d5a3-bbd4-4f23-9378-708cf47bfe3a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.171740 Aug 01 08:00:46.014040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:45 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:46.221220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:46.221863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:46.228184 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:46.228643 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:46.229406 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:46.229843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:46.359792 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:46.369021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6f082611-53f6-49cf-b6bb-e2f811554df9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.152066 Aug 01 08:00:46.369823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 32/63] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:46 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:46.450926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:46.451741 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:46.457933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:46.458380 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:46.459161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:46.459613 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:46.594286 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:46.601900 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6f7a701e-be47-4873-9d2e-0e86d6f64205 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.156078 Aug 01 08:00:46.602475 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 32/64] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:46 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:46.850232 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:46.850865 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:46.857974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:46.858562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:46.859316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:46.859786 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.035025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:47.035778 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:47.046012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:47.046481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.048017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:47.048936 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.077855 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:47.087744 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cc3ea9a6-a8cb-421e-a6b8-d24f800951ba tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.241191 Aug 01 08:00:47.090718 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:46 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:47.215984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:47.223768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9e9a07cf-0d9d-4711-b5b3-5e9d5703b2f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.193294 Aug 01 08:00:47.224339 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:47 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:47.403295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:47.404025 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:47.421469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:47.422241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.424493 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:47.425802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.613141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:47.622421 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6817bb4a-4ef4-4465-9572-294c0065b14c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.234773 Aug 01 08:00:47.625860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:47.626479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:47.634216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:47 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:47.634417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:47.634723 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.635995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:47.637641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:47.802294 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:47.820524 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6aba0b44-575b-4a83-bdd1-0dcc8b4e0e81 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.198618 Aug 01 08:00:47.821998 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 34/68] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:47 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:48.112212 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:48.112847 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:48.118875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.119267 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.120058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.120526 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.245359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:48.246902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:48.253238 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.253881 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.254680 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.255262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.268135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:48.275809 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d1aac4f3-d97c-42c0-95ab-23da62b18cc7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.167773 Aug 01 08:00:48.276873 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:48 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:48.398369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:48.406139 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-aad84722-4cb3-4bfd-8a48-9c05f585575c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.164762 Aug 01 08:00:48.406863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:48 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:48.648299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:48.648299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:48.653771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.654513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.655986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.656592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.840822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:48.842709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:48.843332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:48.850311 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-060d5891-1513-442d-ae26-335cdedb241e tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.209497 Aug 01 08:00:48.850990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 36/71] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:48 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:48.868328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.870190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:48.872106 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:48.872739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:49.029125 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:49.047998 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c79fe3ee-ef3d-4001-b0a8-18b3d82ba20a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.209280 Aug 01 08:00:49.049038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 36/72] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:48 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:49.298186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:49.298825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:49.305010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:49.305496 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:49.306252 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:49.306691 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:49.429138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:49.429752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:49.436690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:49.437294 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:49.438221 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:49.438427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:49.438991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:49.446683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-19972ef0-6fc5-4957-a5f7-b9889e462d60 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.152801 Aug 01 08:00:49.450045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 37/73] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:49 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:49.590008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:49.598284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d216c78b-f912-4c1d-98ee-3394c2d99d11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.172870 Aug 01 08:00:49.599029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 37/74] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:49 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:49.877670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:49.878278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:49.884220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:49.884674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:49.885432 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:49.885870 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.012176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:50.019734 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dc85e66c-511e-44f2-94a8-eebb020658b7 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.145854 Aug 01 08:00:50.020292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 38/75] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:49 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:50.068824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:50.069432 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:50.075344 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:50.075821 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.081962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:50.081962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.222508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:50.233394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b0fbca8c-1a9b-46d6-9ea8-0c5ed97223c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.168202 Aug 01 08:00:50.234216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:50 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:50.470070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:50.470712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:50.476852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:50.477295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.481443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:50.481443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.814440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:50.814440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:50.814440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:50.814440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.816885 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:50.816885 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:50.817114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:50.817114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e57bc4ba-48d8-4803-86a2-1c04ca44312d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.178969 Aug 01 08:00:50.817114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 39/77] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:50 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:50.817416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:50.817416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0bb97f3e-3d37-4c9d-b812-cba83ef7de51 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.157793 Aug 01 08:00:50.817416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 39/78] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:50 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:51.040851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:51.041467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:51.048753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.049810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.050634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.051075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.225720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:51.233979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f64de2e0-9310-4a99-9686-b94b8e09efe4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.197059 Aug 01 08:00:51.238140 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 40/79] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:51 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:51.254017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:51.261253 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:51.261253 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.261462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.262213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.262646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.405302 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:51.413063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fa9a096a-c034-42fd-88af-92f28d8bae6d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.162866 Aug 01 08:00:51.413662 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 40/80] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:51 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:51.834120 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:51.834736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:51.838683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:51.840234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:51.841278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:51.843592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.844053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.844896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.845334 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.853501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.854254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:51.860552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:51.861079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:52.173604 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:52.175791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:52.181941 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6cdc7df5-0e11-415a-8458-032c02b9849f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.354007 Aug 01 08:00:52.185534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-06e6ed10-bdf1-461b-b8f2-892af91ef57c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.355123 Aug 01 08:00:52.186634 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 41/81] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:51 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:52.195571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 41/82] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:51 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:52.254557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:52.255210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:52.261879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:52.262317 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:52.263073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:52.263509 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:52.405700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:52.417829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-966a9cf1-72f1-463d-bdb6-928951c81977 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.165642 Aug 01 08:00:52.417829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 42/83] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:52 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:52.436707 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:52.437745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:52.450340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:52.450340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:52.450340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:52.450340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:52.799680 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:52.809107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d3c1a884-3bd6-4e1e-af47-696bcf6e0536 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.378405 Aug 01 08:00:52.814026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 42/84] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:52 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:53.203368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:53.204367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:53.208659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:53.209301 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:53.211392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.217804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.217804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.217804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.220109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.220726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.221712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.222323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.367909 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:53.374086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-435a3b18-92ca-4c40-a3c3-c2fdc68c4c27 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.175704 Aug 01 08:00:53.383954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:53 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:53.391692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:53.399157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-62620d49-f682-4ebf-ae7a-38d94ce9cf5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.194608 Aug 01 08:00:53.399752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:53 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:53.438005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:53.438799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:53.445101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.445554 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.446318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.446745 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.588415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:53.597501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-28076b74-54bb-4e3a-823e-743c05dc05cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.163317 Aug 01 08:00:53.598072 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:53 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:53.832001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:53.832609 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:53.834491 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:53.839455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.839930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.840738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:53.841270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:53.974901 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:53.983053 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cca959f9-3b9f-4658-9e6e-17241a74f51f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.154977 Aug 01 08:00:53.995589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 44/88] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:53 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:54.396399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:54.397622 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:54.404715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:54.405160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:54.406268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:54.407143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:54.423666 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:54.428988 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:54.433810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:54.434430 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:54.435217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:54.435685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:54.570846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:54.579492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:54.580801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9977eb82-bfea-4567-ae32-637dcb883b21 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.162705 Aug 01 08:00:54.581508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:54 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:54.586937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6593ed24-3988-4027-b2bf-c59a73037640 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.194308 Aug 01 08:00:54.587921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 45/90] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:54 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:54.617020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:54.617637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:54.623607 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:54.624063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:54.624830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:54.625262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:54.760769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:54.769611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1faa4436-7b49-433d-99b3-cb743197d367 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.156250 Aug 01 08:00:54.770542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 46/91] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:54 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:55.005091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:55.005708 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:55.012530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.014215 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.015341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.015475 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.152696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:55.160784 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3dfc6a4e-0568-4acf-9551-5a30235a0b9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.159661 Aug 01 08:00:55.164807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 46/92] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:54 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:55.602074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:55.602807 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:55.613224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:55.613224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:55.613761 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.613761 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.613761 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.613761 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.615338 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.615818 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.616569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.616997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.635415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:55.852366 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:55.862269 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ccf61995-525b-4804-ace7-eb987e47b3dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.263909 Aug 01 08:00:55.863363 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 47/93] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:55 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:55.869436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:55.871235 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:55.878436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.879025 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.879920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:55.880559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:55.885125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:00:56.118011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:56.118011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-00e618cd-4c28-42c7-a904-4213caece02a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.252578 Aug 01 08:00:56.118011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 48/94] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:55 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:56.137305 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:56.146432 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6a82bbbe-e09a-45cc-9aba-f7718a48c055 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.542268 Aug 01 08:00:56.147012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 47/95] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:55 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:56.181709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:56.182308 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:56.189716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:56.190151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:56.190902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:56.191328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:56.326857 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:56.337990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6511474f-c01f-432d-8723-a6eaa7d758f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.159617 Aug 01 08:00:56.338626 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 49/96] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:56 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:56.883333 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:56.884291 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:56.891150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:56.891715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:56.892669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:56.894247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.056845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:57.068050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c470a4e8-759d-4221-9089-9f09ebb2cc52 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.188005 Aug 01 08:00:57.068227 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 48/97] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:56 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:57.138754 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:57.140318 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:57.147080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:57.147651 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.148475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:57.148979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.168260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:57.169175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:57.175399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:57.176107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.176889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:57.177325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.293037 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:57.300822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d2f2bc1c-d7a5-4943-9c7f-a7e6d6324801 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.166393 Aug 01 08:00:57.301396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 50/98] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:57 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:57.315164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:57.322675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-49704d85-5e1d-46b8-a233-6a10e43fab8f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.158576 Aug 01 08:00:57.333777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:57 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:57.360231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:57.362648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:57.366662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:57.367111 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.367900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:57.368342 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:57.501654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:57.509126 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7932a002-2b72-4040-9b01-8dc70e1c5da5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.152741 Aug 01 08:00:57.509691 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 51/100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:57 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:58.090011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:58.090633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:58.096916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.097582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.098486 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.099017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.273951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:58.282911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ae69040e-e557-4ef0-bd89-0320c4bab9b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.197540 Aug 01 08:00:58.283469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:58 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:58.321400 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:58.322033 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:58.328676 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.329722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.330484 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.330912 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.348243 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:58.348783 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:58.355356 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.355835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.356606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.357043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.485854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:58.495482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0dfe2856-54ae-4376-9650-aa7bae1da5f9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.178048 Aug 01 08:00:58.510528 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 52/102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:58 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:58.510880 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:58.518660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-70840b46-ae69-4574-9457-28b08ae3df0e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.174218 Aug 01 08:00:58.519646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 51/103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:58 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:58.531099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:58.531829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:58.538812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.539346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.540530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:58.541022 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:58.700860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:58.709485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3712e459-48e1-4241-8f85-f66918930791 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.182312 Aug 01 08:00:58.710059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:58 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:59.305737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:59.307225 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:59.315447 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.315945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.316708 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.317181 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.453061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:59.462395 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2703b98d-6745-438f-8d98-b8ba2f0db4e3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.161643 Aug 01 08:00:59.463096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 52/105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:59 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:59.526336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:59.526971 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:59.533204 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.533749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.534441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.534875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.547917 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:59.548548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:59.554839 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.555460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.556268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.556703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.686182 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:59.693692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f2c63af2-b757-43cd-a792-b042d5bd6de0 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.171322 Aug 01 08:00:59.703790 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 54/106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:59 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:00:59.721341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:59.730218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-948d5c3f-ea05-4e2d-83df-1c94463f8eff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.191126 Aug 01 08:00:59.730882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 53/107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:59 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:00:59.732565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:00:59.733174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:00:59.739292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.739803 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.740671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:00:59.741106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:00:59.871702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:00:59.880652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5a79cff0-4d9c-46d5-9272-6768c631b7d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.152437 Aug 01 08:00:59.881232 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:00:59 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:00.490221 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:00.490840 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:00.497579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.498035 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.498809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.499256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.667102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:00.675186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6ff8d832-43e8-4772-8c76-a4a468b5bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.189600 Aug 01 08:01:00.675815 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 54/109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:00 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:00.714596 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:00.715191 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:00.721291 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.721723 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.722543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.722970 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.755643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:00.755643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:00.758755 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.759274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.760055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.761505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.932004 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:00.933353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:00.945095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7c9e788e-c85d-43e8-b306-21f8caef86cd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.234500 Aug 01 08:01:00.946243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 56/110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:00 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:00.951557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:00.952391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:00.958955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-568e0037-0538-4617-8048-66be13c96a9d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.211855 Aug 01 08:01:00.966392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.966392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.966392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:00.966392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:00.966720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 55/111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:00 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:01.112733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:01.121631 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-95acd712-7537-41b4-8818-e7475304f880 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.173897 Aug 01 08:01:01.122354 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 57/112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:00 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:01.696084 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:01.696786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:01.704645 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:01.705101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:01.706227 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:01.710493 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:01.875879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:01.883443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-75629f43-1baa-4a28-8532-12e9f945d06d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.191296 Aug 01 08:01:01.891694 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 56/113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:01 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:01.967874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:01.968528 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:01.974607 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:01.975072 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:01.975835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:01.976270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:01.984702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:01.985460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:01.991424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:01.991905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:01.992693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:01.993262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:02.161812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:02.162486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:02.170457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-753e0adb-1a0e-44b2-91c4-9e6aae22d7d1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.189813 Aug 01 08:01:02.170800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2b990efd-c59f-418f-962a-9b47c9865110 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.206773 Aug 01 08:01:02.171197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 57/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:01 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:02.171364 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 58/115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:01 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:02.180036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:02.180646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:02.188331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:02.188948 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:02.189861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:02.190298 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:02.344224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:02.351839 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1c84d980-6fb1-497c-a905-7195f2aaba75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.175450 Aug 01 08:01:02.352407 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:02 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:02.904598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:02.905214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:02.912181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:02.912654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:02.913894 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:02.914348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.078402 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:03.087142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-01b42cdc-5d7b-46b5-b546-fb5800a0ea30 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.186285 Aug 01 08:01:03.100975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 59/117] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:02 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:03.140164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-29f59661-0b0d-455c-b0dc-dd9e565ca52e req-9ba35a31-204a-452c-bfd0-b04b7c12e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88215f9b-01f1-4d7a-8ab7-6f7d59a91da2", "name": "network-vif-plugged", "status": "completed", "tag": "3f8c2167-1c04-439c-83cb-a7061150f73e"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:03.153601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-29f59661-0b0d-455c-b0dc-dd9e565ca52e req-9ba35a31-204a-452c-bfd0-b04b7c12e5fd service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.154040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-29f59661-0b0d-455c-b0dc-dd9e565ca52e req-9ba35a31-204a-452c-bfd0-b04b7c12e5fd service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.176432 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-29f59661-0b0d-455c-b0dc-dd9e565ca52e req-9ba35a31-204a-452c-bfd0-b04b7c12e5fd service nova] Creating event network-vif-plugged:3f8c2167-1c04-439c-83cb-a7061150f73e for instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 on hv-cinder-74014 Aug 01 08:01:03.185414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-29f59661-0b0d-455c-b0dc-dd9e565ca52e req-9ba35a31-204a-452c-bfd0-b04b7c12e5fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111390 Aug 01 08:01:03.187896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 59/118] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:03.193165 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:03.194039 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:03.195680 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:03.196388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:03.201694 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.204531 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.204732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.204812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.204884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.204972 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.205056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.205056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.338290 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:03.351018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-89f0863a-b03e-45f9-b9ad-fe4fedd38338 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.162429 Aug 01 08:01:03.351827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 60/119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:03 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:03.374936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:03.375571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:03.383172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.383658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.384791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:03.385428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:03.403889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:03.418933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2f163937-58ba-4baa-85e3-4d26cbfe83f9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.229936 Aug 01 08:01:03.419518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 60/120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:03 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:03.551170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:03.570042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a6fad13c-2c09-40e3-aac8-19302be609d0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.200853 Aug 01 08:01:03.570631 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 61/121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:03 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:04.108129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:04.108738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:04.114618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.115055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.115826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.116255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.311902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:04.324522 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dbfa97a2-7982-4290-b3b6-005baf65ec08 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.220086 Aug 01 08:01:04.325674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 61/122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:04 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:04.374966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:04.375614 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:04.382563 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.383042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.384051 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.384534 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.440758 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:04.441731 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:04.451615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.452766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.453139 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.454578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.524179 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:04.533407 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-48308bba-7a9a-4725-b3e9-4743b9a60bce tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.162180 Aug 01 08:01:04.534554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 62/123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:04 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:04.591321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:04.592013 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:04.598265 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.598828 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.599696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:04.600191 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:04.693208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:04.704858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2b222b2d-9853-4bb0-bab5-f23de6cc3043 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.267956 Aug 01 08:01:04.705443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 62/124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:04 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:04.778196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:04.787885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0077d305-8e46-4846-82a6-2543b21eb223 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.200439 Aug 01 08:01:04.805117 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 63/125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:04 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:05.204418 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-16793bc3-50b4-4cb6-9667-2a5596487385 req-25f892c5-90f8-4663-b915-be153f87872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518e1fe8-c4a4-4e72-9984-324ab59f6683", "name": "network-vif-plugged", "status": "completed", "tag": "08766321-ade9-4163-8a76-f1980b912511"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:05.215614 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-16793bc3-50b4-4cb6-9667-2a5596487385 req-25f892c5-90f8-4663-b915-be153f87872a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.216397 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-16793bc3-50b4-4cb6-9667-2a5596487385 req-25f892c5-90f8-4663-b915-be153f87872a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.227773 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-16793bc3-50b4-4cb6-9667-2a5596487385 req-25f892c5-90f8-4663-b915-be153f87872a service nova] Creating event network-vif-plugged:08766321-ade9-4163-8a76-f1980b912511 for instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 on hv-cinder-74014 Aug 01 08:01:05.234422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-16793bc3-50b4-4cb6-9667-2a5596487385 req-25f892c5-90f8-4663-b915-be153f87872a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Aug 01 08:01:05.235454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 63/126] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:05.346172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:05.346879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:05.353293 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.354160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.354990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.355435 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.501647 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:05.505061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:05.509326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9daf5bdc-b793-49cd-aa5a-fad9dbacfb97 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.167457 Aug 01 08:01:05.510478 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 64/127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:05 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:05.556544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:05.557393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:05.563713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.564166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.564925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.565363 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.696768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:05.705337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-198493be-9b24-4be0-8672-94e7208864c9 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.152938 Aug 01 08:01:05.705980 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 64/128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:05 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:05.724923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:05.725535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:05.732091 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.732532 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.733479 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.734079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.813123 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:05.813756 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:05.820005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.820456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.821224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:05.821659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:05.840765 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:05.898078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:05.906964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8ab1ed1c-4f0a-4b45-a934-61510292786c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.185961 Aug 01 08:01:05.907956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 65/129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:05 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:05.957971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:05.966730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2cdbf5a6-a20d-4976-ab3a-3b1c235be4c7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.157411 Aug 01 08:01:05.967319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 65/130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:05 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:06.531695 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:06.532436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:06.538372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.538824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.539622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.540058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.687365 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:06.695120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-16907801-078d-4d1a-acad-58c9d4a3cf3e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.167330 Aug 01 08:01:06.697708 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 66/131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:06 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:06.727925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:06.729443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:06.735888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.736346 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.737096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.737531 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.886461 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:06.896891 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5220e9e3-a806-44b5-9456-67fd1404b792 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.172655 Aug 01 08:01:06.897476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 66/132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:06 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:06.928057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:06.928690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:06.934538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.934982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.935788 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.936218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.988301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:06.988944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:06.994968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.995412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:06.996211 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:06.996682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:07.065633 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:07.073801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-050c0693-9160-4285-bba4-46aa9c70b7ff tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.149564 Aug 01 08:01:07.074372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 67/133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:06 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:07.133700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:07.141878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2ed93ad8-ec46-4fff-8ba6-9e98b0a97c85 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.157588 Aug 01 08:01:07.142449 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 67/134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:06 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:07.716052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:07.716657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:07.722853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:07.723303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:07.724137 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:07.724575 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:07.861369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:07.868656 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bd1b23a1-f911-4e2f-8ecd-d44bb80b86ed tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.156474 Aug 01 08:01:07.869985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 68/135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:07 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:07.919085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:07.919794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:07.926078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:07.926541 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:07.927297 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:07.927780 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:07.937515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-949359329", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "networks": [{"uuid": "09f62a76-fcab-4a04-9cba-b511fa777afb"}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:07.992795 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] validate_networks() for [('09f62a76-fcab-4a04-9cba-b511fa777afb', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:01:08.068305 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:08.076043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1281844a-112d-44f0-9158-83ea9fb74b38 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.161586 Aug 01 08:01:08.076645 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 68/136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:07 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:08.095828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:08.096762 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:08.103494 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.104561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.105295 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.106839 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.240277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:08.247758 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e903924e-5de8-4d40-8d62-54e1a058497d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.156077 Aug 01 08:01:08.259796 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 69/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:08 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:08.259796 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:08.259796 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:08.259796 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.260481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.260849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.261399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.353367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:01:08.353980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:01:08.354521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:01:08.354910 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:01:08.362169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:01:08.364307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.364742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.365624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.366121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.389610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Getting quotas for project c7089377e1ee4c64973fe9d8a1b59735. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:01:08.393990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Getting quotas for user 19c483a587bf423aaa0fdb9b4e24ce9d and project c7089377e1ee4c64973fe9d8a1b59735. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:01:08.403987 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:08.406720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:01:08.409360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:01:08.415850 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b87ec368-dfbb-42b6-9426-ecebe50efc25 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.164172 Aug 01 08:01:08.431271 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:08 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:08.543552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-138f2aa2-fcc7-48d3-b754-848ef123755a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609899 Aug 01 08:01:08.544198 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 69/139] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 08:01:08.554940 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-78fce668-57e5-4da7-a5e6-c7fa1ea90223 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:08.555630 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-78fce668-57e5-4da7-a5e6-c7fa1ea90223 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:08.616518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-78fce668-57e5-4da7-a5e6-c7fa1ea90223 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:08.624055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-78fce668-57e5-4da7-a5e6-c7fa1ea90223 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1213 microversion: 2.1 time: 0.072822 Aug 01 08:01:08.624821 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 71/140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:08 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:08.892937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:08.893678 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:08.900801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:08.900801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.901152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:08.901763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:08.902192 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.091556 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:09.099575 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:09.100304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:09.105129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d8e70e1f-0783-4f2c-a2d0-9b7f51bf1fc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.214587 Aug 01 08:01:09.105946 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:08 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:09.110718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.115115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.116183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.117239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.148310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-3990fcf6-a8cd-4b36-a83d-03941bd1f7ec req-550521ab-fef3-4b02-8fb8-0b18a0b003a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90208b0f-9714-4c0b-8a4d-65014a5fbe42", "name": "network-vif-plugged", "status": "completed", "tag": "2a5cb53b-f343-4566-ae09-a9b80633224a"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:09.170384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-3990fcf6-a8cd-4b36-a83d-03941bd1f7ec req-550521ab-fef3-4b02-8fb8-0b18a0b003a8 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.170992 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-3990fcf6-a8cd-4b36-a83d-03941bd1f7ec req-550521ab-fef3-4b02-8fb8-0b18a0b003a8 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.186476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-3990fcf6-a8cd-4b36-a83d-03941bd1f7ec req-550521ab-fef3-4b02-8fb8-0b18a0b003a8 service nova] Creating event network-vif-plugged:2a5cb53b-f343-4566-ae09-a9b80633224a for instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 on hv-cinder-74014 Aug 01 08:01:09.191649 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-3990fcf6-a8cd-4b36-a83d-03941bd1f7ec req-550521ab-fef3-4b02-8fb8-0b18a0b003a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047424 Aug 01 08:01:09.192260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 71/142] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:09.273262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:09.274099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:09.283557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:09.284867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.286324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.289875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.290321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.299262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5f74eec9-7ea0-4243-9c8a-c4ea7e43d67c tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.206027 Aug 01 08:01:09.305985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 72/143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:09 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:09.438787 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:09.438945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:09.439677 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:09.446262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.446904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.448710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:09.449513 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:09.449707 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-912cda6f-76c8-4603-952f-260199ed42a5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.180740 Aug 01 08:01:09.460567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 72/144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:09 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:09.588799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:09.596115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c0b0633d-a18e-419f-8ab7-a7189975c7aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.161191 Aug 01 08:01:09.596674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 73/145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:09 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:09.645324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d6c0f728-7965-4f74-9b20-1c5d5c67586f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:09.645935 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d6c0f728-7965-4f74-9b20-1c5d5c67586f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:09.699793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d6c0f728-7965-4f74-9b20-1c5d5c67586f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:09.706397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d6c0f728-7965-4f74-9b20-1c5d5c67586f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1213 microversion: 2.1 time: 0.064965 Aug 01 08:01:09.706960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 73/146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:09 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:10.128368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:10.129008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:10.135310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.135785 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.136530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.136957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.262422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:10.269701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-58aeda6b-aaf8-4592-b2d0-674fc2224783 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.145152 Aug 01 08:01:10.270259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 74/147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:10 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:10.320853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:10.321492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:10.328106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.328603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.329360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.329801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.459120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:10.466643 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2c5255cf-2b7f-42dc-a093-c87d3af1b5c1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.149840 Aug 01 08:01:10.467203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 74/148] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:10 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:10.471286 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:10.471917 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:10.477900 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.478411 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.479136 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.479585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.609966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:10.617574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-67b0bd38-7378-4b72-9965-2367d4a11d81 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.150220 Aug 01 08:01:10.618128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 75/149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:10 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:10.620962 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:10.621574 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:10.627804 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.628255 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.629016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.629447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.727459 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:10.728731 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:10.731733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:10.735137 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.738024 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.738024 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:10.738024 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:10.757917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:10.766758 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0e554261-0f2f-41d2-a5a3-f46f5a15eb62 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.151160 Aug 01 08:01:10.767462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 75/150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:10 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:10.797762 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:10.805002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e6e20519-fad5-4fd4-9952-0e758085a2a5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1217 microversion: 2.1 time: 0.081534 Aug 01 08:01:10.805563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 76/151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:10 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:11.290104 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:11.291360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:11.297571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.298015 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.298769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.299177 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.427352 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:11.435128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1c114462-e0aa-4f82-a28a-4f865e84672a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.148831 Aug 01 08:01:11.435709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 76/152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:11 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:11.487571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:11.488701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:11.494926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.502888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.502888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.502888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.623863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:11.631213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7034b004-f647-428a-b72a-7c88ae97ecd4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.147448 Aug 01 08:01:11.632582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 77/153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:11 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:11.638660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:11.639270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:11.645122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.645568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.646376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.646757 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.771914 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:11.779408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8383d84b-9c50-4fad-9a86-631dac76237a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.145174 Aug 01 08:01:11.780006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 77/154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:11 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:11.786856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:11.787474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:11.793711 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.794161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.794918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.795355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.826446 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:11.827155 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:11.833167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.833969 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.835080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:11.835599 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:11.898805 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:11.906392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-075463b1-0b88-4df8-812b-070a8c866130 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1217 microversion: 2.1 time: 0.084374 Aug 01 08:01:11.906955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 78/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:11 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:11.926840 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:11.934951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bd4249ba-5e85-4994-be7f-33f9a69a4d64 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.151905 Aug 01 08:01:11.935514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 78/156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:11 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:12.456848 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:12.457378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:12.463869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.464314 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.465071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.465554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.590667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:12.598035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1da7bb3a-362a-43a1-8f52-35240458d9be tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.145454 Aug 01 08:01:12.598593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 79/157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:12 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:12.652498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:12.653119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:12.659163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.659654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.660419 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.660858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.792172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:12.800050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ccf212fa-3d12-4837-b6b3-1f909a6a0ebf tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.151936 Aug 01 08:01:12.800624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 79/158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:12 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:12.801576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:12.802200 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:12.808406 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.808839 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.809745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.810331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.926537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:12.927151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:12.933169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.933616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.934376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.934813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.935383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:12.942753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6d719226-7efb-42fc-af6e-db9f3b75d849 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.146062 Aug 01 08:01:12.943307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 80/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:12 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:12.955934 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:12.956673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:12.963375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.963863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.964626 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:12.965065 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:12.997488 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:13.004904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c0a699e4-7181-4748-a77f-38c0b49b8291 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1217 microversion: 2.1 time: 0.082210 Aug 01 08:01:13.005508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 80/160] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:12 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:13.094503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:13.101900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f3e6a3d1-e727-47bb-a927-f167c08a8d4f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.149662 Aug 01 08:01:13.102459 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 81/161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:12 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:13.618070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:13.619639 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:13.625814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:13.626263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:13.627017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:13.627448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:13.758478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:13.767008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1b81b60b-f962-4d25-ac4c-7cab420252db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.152729 Aug 01 08:01:13.767797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 81/162] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:13 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:13.820907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:13.821512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:13.827782 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:13.828227 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:13.829248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:13.829677 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:13.953028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:13.960550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-59f94c69-583e-4ec2-8e3f-8b5f5a27b6bd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.143458 Aug 01 08:01:13.961107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 82/163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:13 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:13.964889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:13.965497 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:13.971297 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:13.971776 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:13.972515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:13.972941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.026343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:14.026942 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:14.032892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.033331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.034075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.034495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.094543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:14.098229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:14.101978 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:14.102631 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-50cde99c-623e-4878-b1da-d5ffc6cd3e1a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1217 microversion: 2.1 time: 0.080850 Aug 01 08:01:14.104002 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 83/164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:14 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:14.110174 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3099e73f-7976-4f9e-99df-43f85f647600 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.149721 Aug 01 08:01:14.110906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 82/165] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:13 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:14.122461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:14.123056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:14.129137 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.129574 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.130315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.130771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.259293 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:14.266820 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d31149c8-db1f-4ace-b159-768b6d7ec396 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.148590 Aug 01 08:01:14.267369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 84/166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:14 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:14.787917 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:14.788532 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:14.794631 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.795072 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.796092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.796517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.800368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:14.982785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:14.983486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:14.989710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.990184 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:14.990950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:14.991380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.081276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:15.088828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1b79cc0e-f353-4022-b368-7454004a3443 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.304683 Aug 01 08:01:15.089398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 83/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:14 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:15.120523 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:15.124597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:15.125149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:15.127952 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a7d1cae6-2464-4c72-baac-6fbfb43fa9ac tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.149436 Aug 01 08:01:15.128754 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 85/168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:14 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:15.131250 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:15.131747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.132572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:15.133014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.141458 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:15.142219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:15.148405 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:15.149032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.150128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:15.150629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.195119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:15.202667 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6c77d5df-619e-436d-a1ca-ae1654dbed84 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1217 microversion: 2.1 time: 0.081888 Aug 01 08:01:15.203229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 84/169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:15 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:15.289242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:15.290056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:15.290159 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:15.296573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:15.296875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.297629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:15.298215 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:15.299572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-009a8dec-bf84-4628-be39-35fdb5088383 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.161725 Aug 01 08:01:15.300399 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 86/170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:15 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:15.433701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:15.441477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-00d58e69-2e14-4a72-9665-7ca961ba7f8f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.156886 Aug 01 08:01:15.442188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 85/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:15 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:16.109630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:16.110838 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:16.117710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.118161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.119080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.119515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.149116 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:16.150642 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:16.157524 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.158478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.159492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.160681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.436249 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:16.444566 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-44d899b7-5bcb-4b9e-9b7d-3455172a99ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.338654 Aug 01 08:01:16.445360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 87/172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:16 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:16.450251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:16.450852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:16.456804 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.457479 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.458407 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.458843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.547860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:16.555975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:16.568157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-02d2db10-6372-4376-8922-7439e40760a1 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.422506 Aug 01 08:01:16.569797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 86/173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:16 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:16.576656 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:16.577799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:16.580296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-015a500f-2e9b-4d99-8a9e-de2566c2bcf3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1209 microversion: 2.1 time: 0.133658 Aug 01 08:01:16.581299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 88/174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:16 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:16.585124 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.585773 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.586660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.590085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.590233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-d4711b34-0609-45f1-b739-2f733bb5ca90 req-d1b03032-aa19-4437-b1c2-a905429be930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f414074-c855-47d5-b2f8-ed5bb4b20b50", "name": "network-vif-plugged", "status": "completed", "tag": "9fa8b862-e443-4998-b915-92bdaff39190"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:16.612466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-d4711b34-0609-45f1-b739-2f733bb5ca90 req-d1b03032-aa19-4437-b1c2-a905429be930 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.613021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-d4711b34-0609-45f1-b739-2f733bb5ca90 req-d1b03032-aa19-4437-b1c2-a905429be930 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.625466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-d4711b34-0609-45f1-b739-2f733bb5ca90 req-d1b03032-aa19-4437-b1c2-a905429be930 service nova] Creating event network-vif-plugged:9fa8b862-e443-4998-b915-92bdaff39190 for instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 on hv-cinder-74014 Aug 01 08:01:16.630797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-d4711b34-0609-45f1-b739-2f733bb5ca90 req-d1b03032-aa19-4437-b1c2-a905429be930 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047459 Aug 01 08:01:16.631486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 89/175] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:16.638080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:16.638851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:16.645565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.646254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.647182 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:16.647907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:16.749701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:16.757839 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-04755a37-0af7-46e5-b65d-fd693ed3d464 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.186909 Aug 01 08:01:16.759455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 87/176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:16 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:16.807044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:16.814864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7c05ab42-701a-4cff-92df-42534f832e0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.182167 Aug 01 08:01:16.815436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 90/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:16 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:17.465608 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:17.466159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:17.472263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.472711 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.473469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.473904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.599979 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:17.600742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:17.601416 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:17.608036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.608737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.608958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8d96a04e-c7ed-4c46-bb2c-9128d9e04024 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.147286 Aug 01 08:01:17.609568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 88/178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:17 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:17.609729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.610139 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.615033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:17.615676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:17.622216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.622665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.623487 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.623957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.702615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:17.711747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ae6c061d-05bb-4977-bf38-297c35f39f75 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1209 microversion: 2.1 time: 0.100019 Aug 01 08:01:17.712860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 89/179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:17 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:17.782861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:17.783722 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:17.793426 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.794344 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.795821 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.796373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.941319 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:17.941470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:17.948975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9c8492bf-cf1f-4a38-998a-cdee318bdd73 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.352115 Aug 01 08:01:17.949127 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c1bafb46-a44e-4cca-ace7-d5a29a542152 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.171649 Aug 01 08:01:17.950266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 91/180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:17 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:17.954151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:17 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:17.955014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:17.955795 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:17.961798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.963005 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:17.963960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:17.964521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.096259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:18.103823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-996cf9d6-cf0a-421d-a827-1da2d827e963 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.152323 Aug 01 08:01:18.104415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 92/182] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:17 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:18.630278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:18.630894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:18.632812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:18.638496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.638958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.639775 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.640219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.647648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-74441a5a-40bf-4c48-9da0-b9b7e021c601 req-fd6623de-72b1-44ae-8ca1-460dd82aa351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb98b62-cfe8-45eb-95c6-c705fccab622", "name": "network-vif-plugged", "status": "completed", "tag": "2d0b2d0a-db6a-41b3-b644-b06af8787bc8"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:18.652731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:18.658026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-74441a5a-40bf-4c48-9da0-b9b7e021c601 req-fd6623de-72b1-44ae-8ca1-460dd82aa351 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.658458 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-74441a5a-40bf-4c48-9da0-b9b7e021c601 req-fd6623de-72b1-44ae-8ca1-460dd82aa351 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.669882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-74441a5a-40bf-4c48-9da0-b9b7e021c601 req-fd6623de-72b1-44ae-8ca1-460dd82aa351 service nova] Creating event network-vif-plugged:2d0b2d0a-db6a-41b3-b644-b06af8787bc8 for instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 on hv-cinder-74014 Aug 01 08:01:18.675268 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-74441a5a-40bf-4c48-9da0-b9b7e021c601 req-fd6623de-72b1-44ae-8ca1-460dd82aa351 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Aug 01 08:01:18.675940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 93/183] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:01:18.733752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:18.734652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:18.741282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.741689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.742450 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.742881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.773225 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:18.780641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d472e534-515c-4b9c-b576-365706e142dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.154279 Aug 01 08:01:18.781206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 91/184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:18 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:18.808371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:18.816002 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-95d4191b-7eda-4931-abfe-8af5896599f6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1209 microversion: 2.1 time: 0.086495 Aug 01 08:01:18.816557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 94/185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:18 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:18.971115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:18.971925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:18.975178 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:18.976130 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:18.979802 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.980247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.981015 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.981442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.985141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.985590 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:18.986357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:18.986784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:19.127921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:19.135789 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-79d04750-a533-4811-a77f-a7ba314ed478 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1315 microversion: 2.1 time: 0.169260 Aug 01 08:01:19.140060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 92/186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:18 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:19.141452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:19.146371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:19.153416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:19.153534 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e45dca08-d8b0-411c-8fe2-9db98448078e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1365 microversion: 2.1 time: 0.179098 Aug 01 08:01:19.153534 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 95/187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:18 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:19.153856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:19.154305 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:19.155065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:19.155492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:19.289879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:19.298087 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-827e3e13-7802-48d6-b004-5b5ee3b8b956 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.156893 Aug 01 08:01:19.298655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 93/188] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:19 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:19.802590 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:19.803188 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:19.809852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=8 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:19.818461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:19.819134 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:19.820155 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:19.820783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:19.838878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:19.838878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:19.844509 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:19.845027 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:19.845795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:19.846228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.001717 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:20.017177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b1fc883c-bd19-41de-9ba5-b338ba130546 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1265 microversion: 2.1 time: 0.182459 Aug 01 08:01:20.018276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 94/189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:19 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:20.031510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:20.044196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c9f5033c-cb8c-4dda-bbb5-bf4da27a6383 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.245592 Aug 01 08:01:20.045376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 96/190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:19 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:20.156088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:20.156690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:20.162633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.163050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.163822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.164248 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.172503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:20.177250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:20.179498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.180024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.181353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.182123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.300280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:20.308474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-517e23e6-daf2-42eb-b9f5-7dab9e0ca420 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1502 microversion: 2.1 time: 0.156156 Aug 01 08:01:20.309206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 95/191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:20 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:20.318384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:20.319378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:20.321627 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:20.326040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.326500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.327270 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.327905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.331380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0e9fcfac-b2d9-4219-8da3-fdaabf36fb3c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1555 microversion: 2.1 time: 0.162373 Aug 01 08:01:20.331380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 97/192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:20 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:20.355721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:20.356437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:20.363634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.363634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.363874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:20.364460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:20.484260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:20.492352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ae75b0cc-cb00-4196-bf0f-3062f193f8d4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.177984 Aug 01 08:01:20.493114 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 96/193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:20 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:20.504808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-703af6e6-958c-44d4-9e56-7c0aa954e0e1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156980 Aug 01 08:01:20.505440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 98/194] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:01:20 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:01:21.038331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:21.039025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:21.047933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:21.059942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:21.059942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:21.059942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:21.066497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:21.067096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:21.102354 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:21.107345 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:21.115216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:21.116379 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:21.302670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:21.307392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:21.312180 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c608d600-1a5b-4831-8643-51d303285153 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1265 microversion: 2.1 time: 0.278132 Aug 01 08:01:21.320050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 97/195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:21 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:21.320185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-46b624a2-c626-4d59-a637-f2b792d850ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.255367 Aug 01 08:01:21.320185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 99/196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:21 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:21.514698 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:21.515456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:21.522144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:21.522605 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:21.523370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:21.523827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:21.722172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:21.730032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-46045ce3-5aa6-4478-a4f3-e5462ab37d5a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.219200 Aug 01 08:01:21.730713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 98/197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:21 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:22.339588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:22.341262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-b0d5e410-4587-4280-a57e-274592272cee req-6c39cf98-f6f0-4b67-a220-2b9303bb8c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518e1fe8-c4a4-4e72-9984-324ab59f6683", "tag": "08766321-ade9-4163-8a76-f1980b912511"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:22.342632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:22.357906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.386467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.386467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.386467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.388031 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-b0d5e410-4587-4280-a57e-274592272cee req-6c39cf98-f6f0-4b67-a220-2b9303bb8c93 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.388031 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-b0d5e410-4587-4280-a57e-274592272cee req-6c39cf98-f6f0-4b67-a220-2b9303bb8c93 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.394292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-b0d5e410-4587-4280-a57e-274592272cee req-6c39cf98-f6f0-4b67-a220-2b9303bb8c93 service nova] Creating event network-changed:08766321-ade9-4163-8a76-f1980b912511 for instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 on hv-cinder-74014 Aug 01 08:01:22.408918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-b0d5e410-4587-4280-a57e-274592272cee req-6c39cf98-f6f0-4b67-a220-2b9303bb8c93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073320 Aug 01 08:01:22.410165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 99/198] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:01:22.418109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:22.419164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:22.426504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.427232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.428036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.428471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.447466 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:22.508317 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:22.517737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-291d2ca2-f41a-4f4c-9674-7fbec61c8df7 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1273 microversion: 2.1 time: 0.188193 Aug 01 08:01:22.532452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:22 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:22.677228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:22.691695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4176eca6-f87e-46f1-bbe8-9135a6a768cd tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.279957 Aug 01 08:01:22.692520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 100/200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:22 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:22.751688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:22.752655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:22.766648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.777973 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.778808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:22.779825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:22.982756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:22.990494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-96adbde2-100e-4e00-a1a5-6b65f6b0b385 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1361 microversion: 2.1 time: 0.243922 Aug 01 08:01:22.991921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:22 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:23.357550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52efe4b9-a9be-4dc7-9c5e-2f22e5e7aeba"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:23.361569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:23.370820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:23.371508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:23.372520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:23.373369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:23.544783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:23.546498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:23.554871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:23.556445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:23.557741 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:23.558466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:23.565098 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:23.683701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:23.695554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-928b4145-23b8-47af-8403-772c064dda94 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1271 microversion: 2.1 time: 0.158359 Aug 01 08:01:23.698792 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:23 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:23.713967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:23.714568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:23.733078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:23.733078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:23.733078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:23.733078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:23.932092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:23.940353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6cfdbc47-ab98-4089-a1ba-a38f8a42dec8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.230737 Aug 01 08:01:23.941162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 103/203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:23 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:24.013924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:24.014746 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:24.023323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.024651 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.025804 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.026464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.260941 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:24.271111 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9a952923-17bb-42d2-bd82-3fa9d69b0fef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1546 microversion: 2.1 time: 0.261704 Aug 01 08:01:24.271895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 104/204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:24 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1546 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:24.300165 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:24.300653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:24.307634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.308319 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.309360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.310047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.406986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2efed465-160c-4882-a266-7cd74d95cdce tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114478 Aug 01 08:01:24.407785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 105/205] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:01:24 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:24.643092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9d6d01dc-8367-4b5b-bc04-5d71c19e7425 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "POST /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.290660 Aug 01 08:01:24.647581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 101/206] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:01:23 2022] POST /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2/os-volume_attachments => generated 194 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:24.739888 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:24.741199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:24.749783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.750706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.757006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.757006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.963570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:24.966236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:24.986866 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.989944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:24.991640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:24.991640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:25.081143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:25.093371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f8afe266-8630-4a3f-a0c3-3190295304a3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.356777 Aug 01 08:01:25.095157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 106/207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:24 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:25.464436 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:25.469915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-01189227-21c3-4139-b7cb-f2f2660bf9b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1322 microversion: 2.1 time: 0.511568 Aug 01 08:01:25.481146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 102/208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:24 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:26.119384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:26.121629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:26.131369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.132084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.134065 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.134924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.286139 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-3835e214-96f6-46da-afee-6a4c4b520026 req-37da6873-d23f-4c40-a15f-1842edff6de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f414074-c855-47d5-b2f8-ed5bb4b20b50", "tag": "9fa8b862-e443-4998-b915-92bdaff39190"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:26.298434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-3835e214-96f6-46da-afee-6a4c4b520026 req-37da6873-d23f-4c40-a15f-1842edff6de3 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.298658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-3835e214-96f6-46da-afee-6a4c4b520026 req-37da6873-d23f-4c40-a15f-1842edff6de3 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.310824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-3835e214-96f6-46da-afee-6a4c4b520026 req-37da6873-d23f-4c40-a15f-1842edff6de3 service nova] Creating event network-changed:9fa8b862-e443-4998-b915-92bdaff39190 for instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 on hv-cinder-74014 Aug 01 08:01:26.316361 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-3835e214-96f6-46da-afee-6a4c4b520026 req-37da6873-d23f-4c40-a15f-1842edff6de3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040485 Aug 01 08:01:26.317779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 103/209] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:01:26.398968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:26.407462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e8e135eb-a459-47d8-a211-7101d6591088 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.294450 Aug 01 08:01:26.413756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 107/210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:26 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:26.446965 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-dce51e70-4043-4028-be96-ef75613b9912 req-a819b01c-51da-443b-9cd6-115d8d92dc58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539468f7-6a6d-448f-bef5-f77f8470b4d0", "tag": "44f4de1a-f919-4175-87d3-e798863efa15"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:26.461844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-dce51e70-4043-4028-be96-ef75613b9912 req-a819b01c-51da-443b-9cd6-115d8d92dc58 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.462281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-dce51e70-4043-4028-be96-ef75613b9912 req-a819b01c-51da-443b-9cd6-115d8d92dc58 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.474176 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-dce51e70-4043-4028-be96-ef75613b9912 req-a819b01c-51da-443b-9cd6-115d8d92dc58 service nova] Creating event network-changed:44f4de1a-f919-4175-87d3-e798863efa15 for instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 on hv-cinder-74014 Aug 01 08:01:26.480449 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-dce51e70-4043-4028-be96-ef75613b9912 req-a819b01c-51da-443b-9cd6-115d8d92dc58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039360 Aug 01 08:01:26.481327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 104/211] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:26.498487 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:26.503268 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:26.518951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.520879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.520879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.521659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.752582 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:26.762395 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d47ffb7b-7023-4eca-9969-c7103b308a3a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1515 microversion: 2.1 time: 0.271297 Aug 01 08:01:26.768153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:26 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:26.785599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:26.790145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:26.797202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.797789 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.798642 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:26.799153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:26.824832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'flavor' on Instance uuid 6fb98b62-cfe8-45eb-95c6-c705fccab622 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:01:27.180860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e359a188-b8f9-438e-be53-7cd4d9b8ba2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622/action" status: 200 len: 32 microversion: 2.1 time: 0.398973 Aug 01 08:01:27.181663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 105/213] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:01:26 2022] POST /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622/action => generated 32 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 08:01:27.193176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:27.194543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:27.206140 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:27.207620 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:27.209269 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:27.211954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:27.434218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:27.435722 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:27.446746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:27.447568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:27.449944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:27.450625 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:27.480813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:27.492381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b1e6deb8-7614-46bf-8db3-5cfb25ee06bf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.302338 Aug 01 08:01:27.495619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 109/214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:27 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:28.177795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:28.186290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dbdbd8f7-b19c-47d8-80a1-50488e901953 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.760364 Aug 01 08:01:28.187169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 106/215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:27 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:28.520202 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:28.520920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:28.528594 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:28.529275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:28.530185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:28.530688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:28.730390 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:28.736824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d48e9f7a-48ed-4fda-a2e9-ab89ef025c12 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.220569 Aug 01 08:01:28.738214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 110/216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:28 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:29.206061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:29.209725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:29.213293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:29.213742 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:29.214506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:29.214945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:29.348272 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:29.356401 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a749f927-9d51-4cbd-af1e-ee317b3261fb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.154073 Aug 01 08:01:29.356970 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 107/217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:29 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:29.758854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:29.759626 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:29.766316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:29.766976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:29.767865 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:29.768214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:29.898045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:29.906188 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-817a3326-0596-4226-b543-a2b47628993f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.151432 Aug 01 08:01:29.906742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 111/218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:29 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:30.377744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:30.378357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:30.385593 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:30.392923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:30.392923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:30.392923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:30.523080 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:30.531893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b05505d7-21cb-4d06-b124-98da6295d792 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.157992 Aug 01 08:01:30.532498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 108/219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:30 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:30.928102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:30.928738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:30.935557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:30.936026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:30.936779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:30.937248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:31.066110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:31.075023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7ba439da-b05e-4470-9917-d8a3edfa1f4a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.150667 Aug 01 08:01:31.075723 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 112/220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:30 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:31.557251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:31.557251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:31.560780 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:31.561255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:31.562007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:31.562442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:31.702864 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:31.710411 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-62fac3da-d8d4-4399-a2f4-4c548d4f3894 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.161256 Aug 01 08:01:31.710975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 109/221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:31 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:32.096297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:32.096896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:32.102720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:32.103174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:32.104861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:32.105296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:32.250674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:32.258379 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7af02c76-9ca3-46a5-87e4-34a313bca27b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.165928 Aug 01 08:01:32.258954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 113/222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:32 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:32.730196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:32.730932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:32.738177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:32.738620 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:32.739378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:32.739835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:32.872362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:32.880050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e57547a1-3eca-4913-b1b9-5e996bf7777a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.153760 Aug 01 08:01:32.880626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 110/223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:32 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:33.280010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:33.280564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:33.286418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:33.286861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:33.287767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:33.288199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:33.417783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:33.425584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-248ab3d2-eae3-4266-81a0-31ce1d46bda9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.149466 Aug 01 08:01:33.430589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 114/224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:33 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:33.902386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:33.902887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:33.909422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:33.909872 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:33.910629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:33.911070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:34.038304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:34.046013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e561a8de-d1e7-488f-b93c-7d5430bb3966 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.148090 Aug 01 08:01:34.046579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 111/225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:33 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:34.448690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:34.449231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:34.455270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:34.455748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:34.456510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:34.456943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:34.585064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:34.592467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e5f5abf3-f780-488c-91b6-247fa1f5c9a2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.148899 Aug 01 08:01:34.593251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 115/226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:34 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:35.066124 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:35.066827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:35.073560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:35.074011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:35.074770 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:35.075205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:35.205105 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:35.212929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4c1c83ca-2e99-47cd-b6b1-e241b9a7a3cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.150195 Aug 01 08:01:35.213575 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 112/227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:35 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:35.612728 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:35.613331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:35.619738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:35.620181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:35.620931 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:35.621358 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:35.752122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:35.760277 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7f0d09c6-befe-4fff-b7ed-58b8fc2af2f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.150587 Aug 01 08:01:35.760858 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 116/228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:35 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:36.233816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:36.234430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:36.240878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:36.241321 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:36.242078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:36.242514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:36.366948 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:36.374945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3c001a4b-51ea-4fea-aa9d-02f4c7652e03 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.144991 Aug 01 08:01:36.375550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 113/229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:36 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:36.781911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:36.782523 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:36.788550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:36.789031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:36.789784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:36.790220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:36.920975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:36.928330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-818dab72-c419-4631-badc-1fb24b5273b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.150208 Aug 01 08:01:36.929117 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 117/230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:36 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:37.396112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:37.396751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:37.403498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:37.403975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:37.404732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:37.405162 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:37.531071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:37.538449 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-76b06c0d-6be7-4faa-a40e-b2c3a58c99cb tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.146302 Aug 01 08:01:37.539009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 114/231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:37 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:37.949291 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:37.949900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:37.955870 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:37.956315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:37.957056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:37.957481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:38.085138 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:38.093202 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7bb83264-fc80-4267-a400-267f3e0406a0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.147712 Aug 01 08:01:38.093766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 118/232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:37 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:38.560595 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:38.561147 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:38.567704 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:38.568182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:38.568937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:38.569373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:38.574033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:38.704600 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:38.711895 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ec83f49e-67c1-4a01-af63-94b8960ae5ee tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.155186 Aug 01 08:01:38.712682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 115/233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:38 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:39.113945 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:39.114549 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:39.116400 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=99 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:39.121751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:39.122186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:39.122930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:39.123353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:39.127201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:39.251110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:39.258583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cf664f8b-503f-4835-9f55-d4dfdd455426 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.148352 Aug 01 08:01:39.259380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:39 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:39.732611 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:39.733230 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:39.739744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:39.740193 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:39.740957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:39.741490 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:39.872136 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:39.879522 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-86ac6842-3c83-4de4-a6b6-f59ee2ec5823 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.151731 Aug 01 08:01:39.880110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 116/235] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:39 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:40.279802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:40.280405 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:40.286402 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:40.286844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:40.287619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:40.288054 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:40.421937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:40.427673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b0386424-5b3f-46aa-a893-38f314ef4004 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.151581 Aug 01 08:01:40.428270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 120/236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:40 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:40.900894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:40.901505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:40.903854 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=82 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:40.908592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:40.909037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:40.909797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:40.910229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:41.037994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:41.046192 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2300f9c5-b75e-431f-826e-89e0a74fed91 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.149754 Aug 01 08:01:41.046754 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 117/237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:40 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:41.450043 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:41.450651 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:41.457183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:41.457629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:41.458381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:41.458802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:41.589442 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:41.596849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7a4adb07-9081-4737-8ee8-c4a2ee779472 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.151280 Aug 01 08:01:41.597413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 121/238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:41 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:42.066259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:42.066899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:42.073445 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:42.073894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:42.074659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:42.075096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:42.203570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:42.210977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c6409f4f-b1d1-4375-940f-a2c50b0dea71 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.148587 Aug 01 08:01:42.212037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 118/239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:42 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:42.617988 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:42.618618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:42.624712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:42.625139 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:42.625892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:42.626317 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:42.765749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:42.773766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3ea70f69-6fa6-455e-ba15-6408c8af5f98 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.159706 Aug 01 08:01:42.776911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 122/240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:42 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:42.804017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-9a6606c6-0e90-47d2-b839-c4af320f36c7 req-62498345-f2f8-4eaf-b9fd-d9cbd25850eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539468f7-6a6d-448f-bef5-f77f8470b4d0", "name": "network-vif-plugged", "status": "completed", "tag": "44f4de1a-f919-4175-87d3-e798863efa15"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:42.813874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-9a6606c6-0e90-47d2-b839-c4af320f36c7 req-62498345-f2f8-4eaf-b9fd-d9cbd25850eb service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:42.814308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-9a6606c6-0e90-47d2-b839-c4af320f36c7 req-62498345-f2f8-4eaf-b9fd-d9cbd25850eb service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:42.825918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-9a6606c6-0e90-47d2-b839-c4af320f36c7 req-62498345-f2f8-4eaf-b9fd-d9cbd25850eb service nova] Creating event network-vif-plugged:44f4de1a-f919-4175-87d3-e798863efa15 for instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 on hv-cinder-74014 Aug 01 08:01:42.830896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-9a6606c6-0e90-47d2-b839-c4af320f36c7 req-62498345-f2f8-4eaf-b9fd-d9cbd25850eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 Aug 01 08:01:42.831467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 119/241] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:43.233048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:43.234256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:43.241254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:43.241736 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:43.245302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:43.245302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:43.462242 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:43.480132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-93089b8c-976f-4f2c-9fef-83d27466bf34 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.250684 Aug 01 08:01:43.481712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 123/242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:43 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:43.797024 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:43.800236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:43.807178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:43.808769 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:43.810025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:43.810683 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:44.020570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:44.028593 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6e507e51-193f-456c-a929-db53338874b8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.236379 Aug 01 08:01:44.029238 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 120/243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:43 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:44.507984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:44.508444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:44.514283 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:44.514721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:44.515474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:44.515962 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:44.516086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:44.516494 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:44.522941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:44.524377 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:44.525825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:44.526491 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:44.556256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:01:44.668867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:44.677085 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2db9607f-31bf-4146-86dc-bc1bdcbfc70a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.176478 Aug 01 08:01:44.677655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 124/244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:44 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:44.854409 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-17c2c26c-5d06-4ee0-ae3e-377fc7a77bb4 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 204 len: 0 microversion: 2.1 time: 0.342709 Aug 01 08:01:44.855005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 121/245] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:01:44 2022] DELETE /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 08:01:44.863438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:44.864098 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:44.869991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:44.870481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:44.871223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:44.871690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:45.006123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:45.017954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f6412c8e-bad7-4546-8fea-faa6cc916525 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1554 microversion: 2.1 time: 0.158249 Aug 01 08:01:45.018600 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 125/246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:44 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:45.050720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:45.051418 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:45.058813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:45.059280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:45.060077 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:45.060514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:45.189048 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:45.197132 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7bc28dbf-393d-4090-9377-f3782f15657a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.150602 Aug 01 08:01:45.197707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 122/247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:45 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:45.698830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:45.699433 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:45.705443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:45.705887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:45.706635 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:45.707056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:45.861822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:45.870254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e4d54a17-29ae-49ec-a05f-ad8a33ee454a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.175932 Aug 01 08:01:45.870814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 126/248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:45 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:46.039462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:46.040799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:46.047475 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:46.047956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:46.048719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:46.049145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:46.186282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:46.195005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5c96c1bd-268d-42b1-929a-449ea0960b85 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1554 microversion: 2.1 time: 0.159366 Aug 01 08:01:46.195591 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 123/249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:46 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:46.219455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:46.220384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:46.227921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:46.228439 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:46.229391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:46.229898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:46.364893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:46.373040 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1aac4b41-2f3f-4b43-93a0-2fdf05f957cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.158401 Aug 01 08:01:46.373660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 127/250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:46 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:46.890514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:46.891356 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:46.897357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:46.897993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:46.900793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:46.901451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:47.048466 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:47.057198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cd91f249-e8bd-410c-90f6-f77e4b2c66f3 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1313 microversion: 2.1 time: 0.170352 Aug 01 08:01:47.058006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 124/251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:46 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:47.214993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:47.215611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:47.221475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:47.221914 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:47.222662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:47.223086 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:47.360479 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:47.369378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bc443f84-95c6-47f2-8de7-6edeeeb09f67 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1554 microversion: 2.1 time: 0.158254 Aug 01 08:01:47.369940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 128/252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:47 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:47.400947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:47.404217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:47.411858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:47.412310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:47.414055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:47.414381 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:47.563566 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:47.573015 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-61e4465e-80ec-45ea-982a-d53bc46c594a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.175995 Aug 01 08:01:47.573774 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 125/253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:47 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:48.079705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:48.080692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:48.088223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:48.088861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:48.089625 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:48.090292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:48.223995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:48.232341 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ec9fceef-b7ad-4009-9c75-21233ae7d1de tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1497 microversion: 2.1 time: 0.157853 Aug 01 08:01:48.232904 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 129/254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:48 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:48.399406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:48.401180 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:48.409417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:48.409868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:48.410646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:48.411087 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:48.595202 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:48.595881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:48.602981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:48.603802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:48.604641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:48.605075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:48.660033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:48.671725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0092939a-4740-4b0d-b5c4-a4d59ec81bdd tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1554 microversion: 2.1 time: 0.284538 Aug 01 08:01:48.673067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 126/255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:48 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:48.778074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:48.786593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1fd4b607-9616-440f-981e-62297eb389db tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.195103 Aug 01 08:01:48.787456 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 130/256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:48 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:49.143935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-ff8b89f3-942a-4905-b321-aeb93827c4b3 req-e58e9ece-fde0-4bfe-9d0b-aea5bd56bdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88215f9b-01f1-4d7a-8ab7-6f7d59a91da2", "name": "network-vif-deleted", "tag": "3f8c2167-1c04-439c-83cb-a7061150f73e"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:49.160852 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-ff8b89f3-942a-4905-b321-aeb93827c4b3 req-e58e9ece-fde0-4bfe-9d0b-aea5bd56bdd6 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.161236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-ff8b89f3-942a-4905-b321-aeb93827c4b3 req-e58e9ece-fde0-4bfe-9d0b-aea5bd56bdd6 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.174460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-ff8b89f3-942a-4905-b321-aeb93827c4b3 req-e58e9ece-fde0-4bfe-9d0b-aea5bd56bdd6 service nova] Creating event network-vif-deleted:3f8c2167-1c04-439c-83cb-a7061150f73e for instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 on hv-cinder-74014 Aug 01 08:01:49.181147 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-ff8b89f3-942a-4905-b321-aeb93827c4b3 req-e58e9ece-fde0-4bfe-9d0b-aea5bd56bdd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040097 Aug 01 08:01:49.182572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 127/257] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:01:49.306488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:49.307119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:49.313157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.313606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.314402 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.315011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.344156 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:01:49.700107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:49.700814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:49.707744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.708384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.709524 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.710128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.778987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1755b8f7-2f29-4054-995c-b4ab9b71c716 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 204 len: 0 microversion: 2.1 time: 0.478377 Aug 01 08:01:49.785687 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 131/258] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:01:49 2022] DELETE /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:01:49.786358 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:49.792554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:49.793280 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:49.793917 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d91b92dd-f14b-46a7-9887-84288ba338a3 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1346 microversion: 2.1 time: 0.099707 Aug 01 08:01:49.794485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 128/259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:49 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:49.803346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.803346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.803666 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.804014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.808531 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:49.809148 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:49.815572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.816038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.816821 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:49.817262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:49.989163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:49.999300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:50.000129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-34a6eace-97ba-4dfa-95cf-3f8381ff5044 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.194924 Aug 01 08:01:50.001455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 129/260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:49 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:50.021673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ee13ec0a-e3f6-4115-baba-96c017ba0932 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1503 microversion: 2.1 time: 0.222418 Aug 01 08:01:50.021673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 132/261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:49 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:50.814735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:50.815357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:50.822937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:50.823548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:50.824354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:50.824884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:50.856367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:50.856825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:50.857268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lazy-loading 'fault' on Instance uuid 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:01:50.913249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:50.922260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ece780af-6747-4ffc-83e9-dccf42a62308 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1351 microversion: 2.1 time: 0.111320 Aug 01 08:01:50.923023 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 130/262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:50 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:51.022234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:51.026388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:51.031489 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.032196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.033225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.033843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.035430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:51.036206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:51.045304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.047756 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.048568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.049008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.057282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:51.197731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:51.205720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e61f459d-d212-43be-9894-bb98bf7912c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.187191 Aug 01 08:01:51.206621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:51 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:51.346733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:51.359202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3ca3b9e3-129a-4202-83de-d2e89306ae7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1503 microversion: 2.1 time: 0.329528 Aug 01 08:01:51.360632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:51 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:51.954250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:51.954250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:51.962486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.963619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.965295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.966606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.971613 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:01:51.999090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:51.999428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:51.999985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lazy-loading 'fault' on Instance uuid 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:01:52.047986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570de5da908c4b31a8a22706642aafb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '768f11935fcd4080b5045613f6b7cb28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:52.053621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f8ec4ba9-8611-4e02-8c04-e15b6d62332a tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 200 len: 1351 microversion: 2.1 time: 0.108419 Aug 01 08:01:52.054201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:51 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:52.228801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:52.229429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:52.236816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:52.237257 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:52.238078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:52.238519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:52.390135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:52.390135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:52.393646 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:52.394222 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:52.394996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:52.395434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:52.553006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:52.561579 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7c9f9a0c-d9ec-4784-a4e9-3eb350f3d583 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1503 microversion: 2.1 time: 0.184037 Aug 01 08:01:52.575562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 135/266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:52 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:52.616134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:52.623730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-72dc2c16-d741-40e2-8c31-6af480f8fa3d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.399059 Aug 01 08:01:52.624439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 132/267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:52 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:52.895051 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-4c7372c4-a355-4075-8d57-f11c12721896 req-6f715e1f-ccaa-4e1a-99d6-3ddfccc2aab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539468f7-6a6d-448f-bef5-f77f8470b4d0", "name": "network-vif-deleted", "tag": "44f4de1a-f919-4175-87d3-e798863efa15"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:52.930866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4c7372c4-a355-4075-8d57-f11c12721896 req-6f715e1f-ccaa-4e1a-99d6-3ddfccc2aab9 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:52.931658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4c7372c4-a355-4075-8d57-f11c12721896 req-6f715e1f-ccaa-4e1a-99d6-3ddfccc2aab9 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:52.950653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-4c7372c4-a355-4075-8d57-f11c12721896 req-6f715e1f-ccaa-4e1a-99d6-3ddfccc2aab9 service nova] Creating event network-vif-deleted:44f4de1a-f919-4175-87d3-e798863efa15 for instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 on hv-cinder-74014 Aug 01 08:01:52.958084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-4c7372c4-a355-4075-8d57-f11c12721896 req-6f715e1f-ccaa-4e1a-99d6-3ddfccc2aab9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066742 Aug 01 08:01:52.959490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 136/268] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:01:53.074937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:53.076151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:53.082905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.083350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.084127 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.084562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.108841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] HTTP exception thrown: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Request method failure captured: Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 HTTP/1.1 Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gY2IKzaXKzL7k9u8JlQvOWv1QzDUt-LnU5EY1SMUqbh3mAJpynvKrQXL2Iryw-sPPNN17VbAMHyi_JviZqWl-_hyT2TStUwhuPE8wmsexNCg9ANb6tCo2XcRI5yF7qbXTXDPjQxYvGybp-I0b1_xt0NJPB-xGFvP6p-8yhpwI4a3U Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:01:53.114417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_768f11935fcd4080b5045613f6b7cb28", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 570de5da908c4b31a8a22706642aafb4 Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.115910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '88215f9b-01f1-4d7a-8ab7-6f7d59a91da2'} Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:01:53.116913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.118851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.121398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Returning 404 to user: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:01:53.121398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e3256733-8877-4fb4-ad05-e7ef2e772c9d tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 404 len: 111 microversion: 2.1 time: 0.045593 Aug 01 08:01:53.121398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 133/269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:53 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:01:53.297624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:53.299965 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:53.306411 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.306849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.307664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.308093 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.321892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] HTTP exception thrown: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Request method failure captured: Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2/os-volume_attachments HTTP/1.1 Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gY2IKzaXKzL7k9u8JlQvOWv1QzDUt-LnU5EY1SMUqbh3mAJpynvKrQXL2Iryw-sPPNN17VbAMHyi_JviZqWl-_hyT2TStUwhuPE8wmsexNCg9ANb6tCo2XcRI5yF7qbXTXDPjQxYvGybp-I0b1_xt0NJPB-xGFvP6p-8yhpwI4a3U Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:01:53.327031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_768f11935fcd4080b5045613f6b7cb28", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 570de5da908c4b31a8a22706642aafb4 Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.328530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'server_id': '88215f9b-01f1-4d7a-8ab7-6f7d59a91da2'} Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:01:53.329923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:53.331056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:01:53.332642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Returning 404 to user: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:01:53.332642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-835b2661-d41d-4123-8e76-5c11cad2cc21 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035454 Aug 01 08:01:53.332642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 137/270] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:01:53 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:01:53.584336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:53.586994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:53.593969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.594418 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.595188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.595656 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.629174 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.629659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.630106 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lazy-loading 'fault' on Instance uuid 539468f7-6a6d-448f-bef5-f77f8470b4d0 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:01:53.645535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:53.646569 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:53.659746 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.660481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.661521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:53.662546 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:53.704348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:53.713083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4500ba4b-9d94-4672-afa3-184cdaea5f9c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 200 len: 1303 microversion: 2.1 time: 0.132563 Aug 01 08:01:53.713657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 134/271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:53 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:53.839131 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:53.846706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3a8383fb-9ad0-4f1a-a75d-400ad2f085ea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.205115 Aug 01 08:01:53.847277 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 138/272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:53 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:54.738527 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:54.739257 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 539468f7-6a6d-448f-bef5-f77f8470b4d0] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:54.746323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:54.746766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:54.747543 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:54.747984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:54.762085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] HTTP exception thrown: Instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 could not be found. Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Request method failure captured: Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 HTTP/1.1 Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54hAV5KZ6g4T10aTM0IB2WEvPPGzlY3L_IrOSwflEeSWprKj_gHo4WV3E3MlaeTAwg9E0M1xequqJP15ssH4WxKN-TWJgtw4d9uOZ5lqEEu6wNowa3O3fL70oIi6Xwd4-UPX3itKxIQA1nhUs1XVcm3NWzWKj1E4ZHA83Yyj27CWGhQ Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: c7089377e1ee4c64973fe9d8a1b59735 Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesActionsTest-123095958 Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:01:54.763805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7089377e1ee4c64973fe9d8a1b59735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7089377e1ee4c64973fe9d8a1b59735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7089377e1ee4c64973fe9d8a1b59735", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7089377e1ee4c64973fe9d8a1b59735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesActionsTest-123095958 Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: c7089377e1ee4c64973fe9d8a1b59735 Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesActionsTest-123095958 Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesActionsTest-123095958-project Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 19c483a587bf423aaa0fdb9b4e24ce9d Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesActionsTest-123095958-project Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 could not be found. Aug 01 08:01:54.765258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '539468f7-6a6d-448f-bef5-f77f8470b4d0'} Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 could not be found. Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:01:54.766571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 could not be found. Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 could not be found. Aug 01 08:01:54.767926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:54.769739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Returning 404 to user: Instance 539468f7-6a6d-448f-bef5-f77f8470b4d0 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:01:54.769739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-eebdb0ed-fa04-4f36-af79-236d3bf45cf6 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0" status: 404 len: 111 microversion: 2.1 time: 0.031677 Aug 01 08:01:54.769739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 135/273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:54 2022] GET /compute/v2.1/servers/539468f7-6a6d-448f-bef5-f77f8470b4d0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:01:54.868930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:54.869722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:54.871158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1888183599", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "networks": [{"uuid": "09f62a76-fcab-4a04-9cba-b511fa777afb"}]}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:01:54.877259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:54.877703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:54.878468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:54.878902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:54.930751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] validate_networks() for [('09f62a76-fcab-4a04-9cba-b511fa777afb', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:01:55.023108 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:55.030129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5bd94857-7e89-4ec9-a164-fb8544bfccc1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.165671 Aug 01 08:01:55.030822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 139/274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:54 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:55.322969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:01:55.323464 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:01:55.323970 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:01:55.324552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:01:55.324961 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:01:55.333815 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:55.334515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:55.335315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:55.336303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:55.355918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Getting quotas for project c7089377e1ee4c64973fe9d8a1b59735. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:01:55.359825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Getting quotas for user 19c483a587bf423aaa0fdb9b4e24ce9d and project c7089377e1ee4c64973fe9d8a1b59735. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:01:55.371175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:01:55.373484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:01:55.537092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c4de253b-1566-4268-8d87-bdb1defa5b24 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670166 Aug 01 08:01:55.538022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 136/275] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 08:01:55.548884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c81ac066-dcd8-495e-859c-bab1a3243594 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:55.549577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c81ac066-dcd8-495e-859c-bab1a3243594 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:55.603505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c81ac066-dcd8-495e-859c-bab1a3243594 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:55.610316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c81ac066-dcd8-495e-859c-bab1a3243594 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1214 microversion: 2.1 time: 0.065291 Aug 01 08:01:55.611063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:55 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:56.050761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:56.051370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:56.052429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:56.053043 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:56.058044 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.058480 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.059231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.059328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.059692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.059788 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.060464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.060895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.073134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] HTTP exception thrown: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Request method failure captured: Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: DELETE /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 HTTP/1.1 Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gY2IKzaXKzL7k9u8JlQvOWv1QzDUt-LnU5EY1SMUqbh3mAJpynvKrQXL2Iryw-sPPNN17VbAMHyi_JviZqWl-_hyT2TStUwhuPE8wmsexNCg9ANb6tCo2XcRI5yF7qbXTXDPjQxYvGybp-I0b1_xt0NJPB-xGFvP6p-8yhpwI4a3U Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:01:56.074668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_768f11935fcd4080b5045613f6b7cb28", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 570de5da908c4b31a8a22706642aafb4 Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.075935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '88215f9b-01f1-4d7a-8ab7-6f7d59a91da2'} Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:01:56.076615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.078412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.081725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Returning 404 to user: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:01:56.081725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7c4a2f6b-c10e-46dc-a513-105615c11deb tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "DELETE /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 404 len: 111 microversion: 2.1 time: 0.029673 Aug 01 08:01:56.081725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 137/277] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:01:56 2022] DELETE /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:01:56.084403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:56.085006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] [instance: 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:56.091735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.092291 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.093058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.093558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.109226 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] HTTP exception thrown: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Request method failure captured: Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 HTTP/1.1 Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gY2IKzaXKzL7k9u8JlQvOWv1QzDUt-LnU5EY1SMUqbh3mAJpynvKrQXL2Iryw-sPPNN17VbAMHyi_JviZqWl-_hyT2TStUwhuPE8wmsexNCg9ANb6tCo2XcRI5yF7qbXTXDPjQxYvGybp-I0b1_xt0NJPB-xGFvP6p-8yhpwI4a3U Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:01:56.110777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_768f11935fcd4080b5045613f6b7cb28", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/768f11935fcd4080b5045613f6b7cb28"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 768f11935fcd4080b5045613f6b7cb28 Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-DeleteServersTestJSON-994846486 Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 570de5da908c4b31a8a22706642aafb4 Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-DeleteServersTestJSON-994846486-project Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.111971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '88215f9b-01f1-4d7a-8ab7-6f7d59a91da2'} Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:01:56.112638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. Aug 01 08:01:56.114581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:01:56.115562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] Returning 404 to user: Instance 88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:01:56.115562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-65aad027-c6c7-4743-a277-c7569bc7f167 tempest-DeleteServersTestJSON-994846486 tempest-DeleteServersTestJSON-994846486-project] 10.222.0.48 "GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2" status: 404 len: 111 microversion: 2.1 time: 0.031477 Aug 01 08:01:56.115562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 138/278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:56 2022] GET /compute/v2.1/servers/88215f9b-01f1-4d7a-8ab7-6f7d59a91da2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 08:01:56.232487 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:56.240521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-757177fe-232d-4c5b-9609-942aaa3972f6 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.192062 Aug 01 08:01:56.241089 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 141/279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:56 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:56.630251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:56.630892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:56.637750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.638269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.638991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:56.639433 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:56.757665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:56.766208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f1c5658a-cbfc-4b2d-ab51-bacf87f5709f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1218 microversion: 2.1 time: 0.139788 Aug 01 08:01:56.766785 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 139/280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:56 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:57.263824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:57.264615 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:57.272562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:57.276997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:57.276997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:57.276997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:57.431771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:57.439871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6dafc8dc-e6dd-48e4-96dd-22e3f4d5f016 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.180873 Aug 01 08:01:57.440433 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 142/281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:57 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:01:57.788237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:57.789521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:57.799933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:57.800641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:57.801660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:57.802212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:58.019461 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:58.029697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3597bc90-911e-4dec-99ab-22e60585c31b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1274 microversion: 2.1 time: 0.246178 Aug 01 08:01:58.035662 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 140/282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:57 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:58.464737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:58.466528 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:58.477469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:58.478347 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:58.479626 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:58.480282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:58.818052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:58.836061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3b8695c7-220f-410d-8cad-29c9f5820d76 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.378471 Aug 01 08:01:58.837329 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 143/283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:58 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:59.051558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:59.052213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:59.060937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:59.061719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:59.064709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:59.066751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:59.313883 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:01:59.342296 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-661d1e3e-5658-45ba-9b5b-3def5ce9ec2f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.294899 Aug 01 08:01:59.343684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 141/284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:59 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:01:59.858378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:01:59.858999 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:01:59.889902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:59.890344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:01:59.900784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:01:59.903052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:00.228355 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:00.241584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d952dfa0-fe39-4b1a-bc3d-227af25adfd1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.386909 Aug 01 08:02:00.244110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 144/285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:01:59 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:00.364261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:00.364888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:00.371616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:00.372072 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:00.375182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:00.375182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:00.577858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:00.590538 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0b17731c-81d0-4ab3-a66b-ef337d8a8020 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.230683 Aug 01 08:02:00.591871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 142/286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:00 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:00.947823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-dd2e4ba5-1b6a-4294-8ec9-9e4f83aefa09 req-be83e243-6feb-46db-a14a-e8c2f5f2d227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74db4b58-2bc7-41c2-a1d2-c9480cc96464", "tag": "d89810ad-d9d8-4030-9b73-95092c057631"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:00.982298 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-dd2e4ba5-1b6a-4294-8ec9-9e4f83aefa09 req-be83e243-6feb-46db-a14a-e8c2f5f2d227 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:00.984767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-dd2e4ba5-1b6a-4294-8ec9-9e4f83aefa09 req-be83e243-6feb-46db-a14a-e8c2f5f2d227 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:01.017000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-dd2e4ba5-1b6a-4294-8ec9-9e4f83aefa09 req-be83e243-6feb-46db-a14a-e8c2f5f2d227 service nova] Creating event network-changed:d89810ad-d9d8-4030-9b73-95092c057631 for instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 on hv-cinder-74014 Aug 01 08:02:01.029241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-dd2e4ba5-1b6a-4294-8ec9-9e4f83aefa09 req-be83e243-6feb-46db-a14a-e8c2f5f2d227 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086231 Aug 01 08:02:01.030394 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 145/287] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:02:01.265496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:01.266883 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:01.276553 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:01.277202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:01.277997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:01.278443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:01.513403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:01.527043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1197bb24-fd52-4534-a1e2-96cd1b64b6b4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1521 microversion: 2.1 time: 0.265974 Aug 01 08:02:01.531263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 143/288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:01 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:01.613809 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:01.614500 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:01.621381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:01.624597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:01.624597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:01.624597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:01.808665 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:01.816617 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-69fb29d4-b9b8-47f1-888b-830f315fd9cf tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.207699 Aug 01 08:02:01.817183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 146/289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:01 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:02.553713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:02.554581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:02.561490 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:02.561944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:02.562697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:02.563131 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:02.810175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:02.819101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-633be4b8-68e1-4826-8ba4-56354da5a8a8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1501 microversion: 2.1 time: 0.269275 Aug 01 08:02:02.819753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 144/290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:02 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1501 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:02.841389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:02.842144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:02.848741 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:02.849257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:02.850162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:02.850767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:02.852130 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:02.855905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:02.858914 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:02.859368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:02.860859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:02.861627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:03.003887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:03.011970 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3718d4b9-c53b-42bc-ac48-3be32c1939b1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1516 microversion: 2.1 time: 0.175388 Aug 01 08:02:03.015557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 147/291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:02 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:03.016735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:03.025301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1544a8d6-4a47-42e2-8d07-3c239a0ee33c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.178560 Aug 01 08:02:03.025950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:02 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:04.045916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:04.046521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:04.052517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:04.052981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:04.053712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:04.054327 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:04.208348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:04.216880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-65b6948c-a7ba-4ec3-aa7e-5c5e5bb84f50 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.174904 Aug 01 08:02:04.217754 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 148/293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:04 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:05.237969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:05.238687 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:05.246490 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:05.247186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:05.248201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:05.248788 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:05.344379 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:05.366897 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:05.450816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:05.458277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c075ff52-1a39-4564-8ddc-24d638c0789c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.224112 Aug 01 08:02:05.458843 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 146/294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:05 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:05.922895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:05.925523 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:05.927511 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:05.933790 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:05.934246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:05.935058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:05.935496 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:05.959365 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'flavor' on Instance uuid 90208b0f-9714-4c0b-8a4d-65014a5fbe42 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:02:06.325145 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1aaefe15-8b9c-48e3-abac-8fa9152c35dc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/action" status: 200 len: 32 microversion: 2.1 time: 0.406050 Aug 01 08:02:06.325846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 149/295] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:02:05 2022] POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:02:06.336158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:06.336767 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:06.343929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:06.344580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:06.345340 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:06.345770 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:06.482766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:06.483452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:06.490839 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:06.491355 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:06.492711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:06.493143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:06.573100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:06.582088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a8401fa7-9abe-4066-95ed-56f8955841b7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.250391 Aug 01 08:02:06.583038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:06 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:06.790042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:06.800978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fc5fe177-2bb7-4661-910d-8e79d7205d1b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.322526 Aug 01 08:02:06.807334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 150/297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:06 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:07.608703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:07.610031 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:07.624194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:07.626242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:07.627359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:07.627989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:07.822907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:07.823511 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:07.838856 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:07.839632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:07.840569 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:07.841163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:07.863976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:07.954550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:07.965728 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d4aef748-95c0-4a43-9ebd-1522977c15fb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.365206 Aug 01 08:02:07.967638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 148/298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:07 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:08.029006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:08.042051 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f97aed6a-801a-4df5-b15f-cf032ad92aad tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.223263 Aug 01 08:02:08.047700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 151/299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:07 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:08.988953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:08.989752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:08.999798 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:09.002409 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:09.003561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:09.004009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:09.068624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:09.070074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:09.077553 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:09.078536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:09.079637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:09.080294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:09.229203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:09.237829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-51c1e72c-e56e-4589-82cf-942898e43ebc tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.173639 Aug 01 08:02:09.239071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 152/300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:09 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:09.244475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-7c22d71a-550d-48cd-8862-6990a28eaead req-cdf191e3-4689-400e-a0d8-b2fdcba8e154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74db4b58-2bc7-41c2-a1d2-c9480cc96464", "name": "network-vif-plugged", "status": "completed", "tag": "d89810ad-d9d8-4030-9b73-95092c057631"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:09.245449 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:09.253505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:09.255654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-7c22d71a-550d-48cd-8862-6990a28eaead req-cdf191e3-4689-400e-a0d8-b2fdcba8e154 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:09.256371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-7c22d71a-550d-48cd-8862-6990a28eaead req-cdf191e3-4689-400e-a0d8-b2fdcba8e154 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:09.260141 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-52f4fbcd-579f-481b-b970-80e93252e56d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.274926 Aug 01 08:02:09.261990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 149/301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:08 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:09.269736 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-7c22d71a-550d-48cd-8862-6990a28eaead req-cdf191e3-4689-400e-a0d8-b2fdcba8e154 service nova] Creating event network-vif-plugged:d89810ad-d9d8-4030-9b73-95092c057631 for instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 on hv-cinder-74014 Aug 01 08:02:09.278492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-7c22d71a-550d-48cd-8862-6990a28eaead req-cdf191e3-4689-400e-a0d8-b2fdcba8e154 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038026 Aug 01 08:02:09.279422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 153/302] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:02:10.260214 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:10.260749 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:10.267369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:10.268201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:10.269054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:10.269570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:10.287257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:10.288862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:10.305863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:10.306735 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:10.307841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:10.310740 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:10.502953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:10.508461 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:10.514406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2ac508e8-1b63-4db2-a3b9-29904b19dc29 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.258267 Aug 01 08:02:10.515491 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 150/303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:10 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:10.544506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:10.554689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3f4c20b6-3e6a-42a3-b019-b6be9bae7e89 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.273946 Aug 01 08:02:10.555983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 154/304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:10 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:11.299398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ed1626cf-bb29-430b-b161-de608e393941 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'create', calling method: .version_select at 0x7efe449b2ca0>, body: {"keypair": {"name": "tempest-keypair-1551654738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyHxzZ6TjhAXUbl4ckY8rnrQtT0XZM3ova8n44pgcnrB1SzYeaQAwG/FEgYJ6gzbGON55GkC6zA29E/i6w+XhCAbIQ/mXrnFCnAgKKoE2uwfVbAjFNchFMsArigvgEWAg=="}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:11.305197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:11.320026 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-ed1626cf-bb29-430b-b161-de608e393941 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for project 3129476636bb43e9a14ef674c4720233. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:02:11.324654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-ed1626cf-bb29-430b-b161-de608e393941 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for user 14e5f1b4073742b4b9bd8a48cce38341 and project 3129476636bb43e9a14ef674c4720233. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:02:11.537104 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:11.537631 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:11.544895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:11.546342 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:11.546342 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:11.546577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:11.655489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ed1626cf-bb29-430b-b161-de608e393941 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.533697 Aug 01 08:02:11.656912 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 151/305] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 1 08:02:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 536 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 08:02:11.663076 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:11.663976 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:11.673664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:11.674180 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:11.675292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:11.675868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:11.728530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:11.738158 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9ca812fa-d94f-4f84-8e22-d764de100a7a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1314 microversion: 2.1 time: 0.205673 Aug 01 08:02:11.739207 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 155/306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:11 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:12.085233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:12.094514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dc6a1e52-f34d-4d25-8eff-b3d0e29bcfe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.436421 Aug 01 08:02:12.095350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 152/307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:11 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:12.776562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:12.776562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:12.781975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:12.782606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:12.783372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:12.784002 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:12.946743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:12.954692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a35d55c2-91a2-4974-8e50-f13f8d25958d tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1499 microversion: 2.1 time: 0.185312 Aug 01 08:02:12.955336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 156/308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:12 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1499 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:13.117195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:13.117956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:13.125153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:13.125692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:13.126529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:13.127034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:13.289694 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:13.299395 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9fc6219b-6f75-4197-b6af-ac9a2b17b6c7 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.186798 Aug 01 08:02:13.300082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 153/309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:13 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:13.903817 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:13.904874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:13.911397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:13.912097 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:13.913300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:13.914001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:13.940984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:02:14.242665 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-230bd7f2-ca5b-404f-a499-30f00420f708 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "DELETE /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 204 len: 0 microversion: 2.1 time: 0.342435 Aug 01 08:02:14.244317 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 157/310] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:02:13 2022] DELETE /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:02:14.259250 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:14.259960 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:14.267063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:14.267519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:14.268334 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:14.268775 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:14.322638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:14.323899 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:14.330504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:14.330960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:14.331810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:14.332146 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:14.502372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:14.513252 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-eed2181d-8e8c-4fb3-9b3a-cc3264e4f097 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.195506 Aug 01 08:02:14.520337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:14.530672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 158/311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:14 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:14.532245 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-00b57107-e535-4d58-9fbf-9eda418b47e5 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1505 microversion: 2.1 time: 0.277535 Aug 01 08:02:14.534890 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 154/312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:14 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:14.929422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1642967792", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5256f87-c2ff-467e-8ab7-6b930400a6a4"}], "security_groups": [{"name": "tempest-securitygroup--1347737010"}], "key_name": "tempest-keypair-1551654738", "user_data": "}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:15.090957 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] validate_networks() for [('a5256f87-c2ff-467e-8ab7-6b930400a6a4', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:02:15.538547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:15.539200 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:15.540931 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:02:15.541034 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:02:15.541495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:02:15.541896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:02:15.542722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:02:15.547075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:15.549012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:15.549012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:15.549012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:15.551786 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:15.552228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:15.553591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:15.553956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:15.571990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for project 3129476636bb43e9a14ef674c4720233. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:02:15.576218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for user 14e5f1b4073742b4b9bd8a48cce38341 and project 3129476636bb43e9a14ef674c4720233. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:02:15.590102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:02:15.593993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:02:15.758558 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f36fd68b-1b5a-48f0-be86-424d8fcd933d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.840823 Aug 01 08:02:15.760622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 159/313] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 1 08:02:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 08:02:15.765751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:15.782079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:15.782989 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:15.783109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7e29377f-f83c-4f85-95e8-c0474e6c6053 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.250039 Aug 01 08:02:15.787228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 155/314] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:15 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:15.796101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:15.796683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:15.796812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0eff1006-83f9-404d-be9d-579370f80e6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:15.797658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0eff1006-83f9-404d-be9d-579370f80e6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:15.800168 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:15.801537 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:15.870260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0eff1006-83f9-404d-be9d-579370f80e6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:15.876078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0eff1006-83f9-404d-be9d-579370f80e6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:15.877593 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0eff1006-83f9-404d-be9d-579370f80e6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:15.878778 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0eff1006-83f9-404d-be9d-579370f80e6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1282 microversion: 2.20 time: 0.090080 Aug 01 08:02:15.886117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 156/315] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:15 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:15.981022 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:15.991875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dc08b87d-5e4b-481f-9260-60e86c86d19c tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1505 microversion: 2.1 time: 0.230044 Aug 01 08:02:15.992616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 160/316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:15 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:16.810045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:16.810935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:16.822533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:16.823873 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:16.825790 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:16.826450 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:16.902907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-868191c1-b5ac-4893-bf0e-a83d359f1b3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:16.903863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-868191c1-b5ac-4893-bf0e-a83d359f1b3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:17.000781 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-868191c1-b5ac-4893-bf0e-a83d359f1b3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:17.010783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-868191c1-b5ac-4893-bf0e-a83d359f1b3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:17.012646 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-868191c1-b5ac-4893-bf0e-a83d359f1b3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:17.014220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-868191c1-b5ac-4893-bf0e-a83d359f1b3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1282 microversion: 2.20 time: 0.116264 Aug 01 08:02:17.032544 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 161/317] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:16 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:02:17.038737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-b19342e4-633c-4bb1-91cb-7b9cbbc0fd24 req-38672e86-e464-4554-b997-60ed310a8112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74db4b58-2bc7-41c2-a1d2-c9480cc96464", "name": "network-vif-deleted", "tag": "d89810ad-d9d8-4030-9b73-95092c057631"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:17.050107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-b19342e4-633c-4bb1-91cb-7b9cbbc0fd24 req-38672e86-e464-4554-b997-60ed310a8112 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:17.050743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-b19342e4-633c-4bb1-91cb-7b9cbbc0fd24 req-38672e86-e464-4554-b997-60ed310a8112 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:17.064888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:17.065587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-b19342e4-633c-4bb1-91cb-7b9cbbc0fd24 req-38672e86-e464-4554-b997-60ed310a8112 service nova] Creating event network-vif-deleted:d89810ad-d9d8-4030-9b73-95092c057631 for instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 on hv-cinder-74014 Aug 01 08:02:17.070586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-b19342e4-633c-4bb1-91cb-7b9cbbc0fd24 req-38672e86-e464-4554-b997-60ed310a8112 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039637 Aug 01 08:02:17.071846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 162/318] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:02:17.075197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c691c363-22a3-48b6-9851-4baae1b361d5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.267611 Aug 01 08:02:17.076529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 157/319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:16 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:17.077979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:17.078857 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:17.090990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:17.091436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:17.092230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:17.092663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:17.156628 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:17.164980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6817b711-4682-4711-9c85-64de0ffb33c2 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1463 microversion: 2.1 time: 0.091790 Aug 01 08:02:17.165663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 163/320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:17 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:18.041555 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:18.042359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:18.048957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.049406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.050268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.050655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.098053 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:18.098655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:18.105266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.105711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.111938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.112798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.117692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:18.127399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:18.129127 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:18.130470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8264509e-a32f-4dca-8a65-11c1a0b2159a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1334 microversion: 2.20 time: 0.093355 Aug 01 08:02:18.143376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 158/321] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:18 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:18.188242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:18.188947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:18.195456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.196005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.196792 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.197237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.229996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:18.230451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:18.233472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lazy-loading 'fault' on Instance uuid 74db4b58-2bc7-41c2-a1d2-c9480cc96464 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:02:18.264274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:18.270440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-89a568d4-1b7e-4d54-88a7-75c8c2713501 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.176543 Aug 01 08:02:18.271286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 164/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:18 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:18.276716 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:18.284662 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-88d490e6-a0bf-4992-b051-34e8d8c42e5f tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1304 microversion: 2.1 time: 0.100318 Aug 01 08:02:18.285331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 159/323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:18 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:19.162184 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:19.163028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:19.172520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.172520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.172815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.173266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.238259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:19.246793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:19.248304 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:19.249426 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-104aba0a-06ed-4f7c-9330-1aee9e53af34 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1334 microversion: 2.20 time: 0.091954 Aug 01 08:02:19.249966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 165/324] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:19 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:19.291572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:19.292552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:19.299280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.299869 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.300641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.301088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.312407 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:19.316617 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:19.319910 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.320364 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.321130 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.321560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.351979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:19.352428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:19.352872 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lazy-loading 'fault' on Instance uuid 74db4b58-2bc7-41c2-a1d2-c9480cc96464 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:02:19.392998 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:19.401096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7237d483-5368-41ac-91d4-a93d3de38812 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1304 microversion: 2.1 time: 0.092423 Aug 01 08:02:19.401663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 166/325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:19 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:19.438162 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:19.446468 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f04704fa-4b7e-4810-822f-737c196402b9 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.159099 Aug 01 08:02:19.447025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 160/326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:19 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:20.272733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:20.273335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:20.279272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.279775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.280564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.280996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.343907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:20.352078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:20.353598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:20.354683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-43b84379-9f9d-4baf-aa6d-3e8f5763c14e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1334 microversion: 2.20 time: 0.086424 Aug 01 08:02:20.355228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 167/327] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:20 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:20.422201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:20.422802 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:20.429280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.429718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.430464 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.430889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.463564 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.463941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.464391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lazy-loading 'fault' on Instance uuid 74db4b58-2bc7-41c2-a1d2-c9480cc96464 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:02:20.467987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:20.468598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:20.474807 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.475253 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.476042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:20.476479 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:20.503881 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:20.512310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8819e39c-1b2c-42ec-80b2-1b58d84c4383 tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1304 microversion: 2.1 time: 0.093953 Aug 01 08:02:20.513039 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 161/328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:20 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:20.602311 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:20.609957 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-be5b2da7-9646-40e5-bc63-4cea0ff7904e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.145743 Aug 01 08:02:20.610514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 168/329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:20 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:21.377246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:21.377850 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:21.384316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.384759 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.385511 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.385941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.446437 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:21.454136 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:21.455762 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:21.456873 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a4a2d9d6-ec28-42f6-ac77-c116ed3915c2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1334 microversion: 2.20 time: 0.083756 Aug 01 08:02:21.457562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 162/330] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:21 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1334 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:21.533587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:21.534148 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:21.540144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.540585 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.541403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.542111 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.546274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:21.573980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.574419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.574853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lazy-loading 'fault' on Instance uuid 74db4b58-2bc7-41c2-a1d2-c9480cc96464 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:02:21.613403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c483a587bf423aaa0fdb9b4e24ce9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7089377e1ee4c64973fe9d8a1b59735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:21.621460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b394aaf2-3006-42f3-8eb1-8538fe4b4f6a tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 200 len: 1304 microversion: 2.1 time: 0.091738 Aug 01 08:02:21.622019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 169/331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:21 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:21.630027 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:21.630784 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:21.638173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.638601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.639373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:21.639855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:21.779610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:21.788108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ce45fd9a-f95f-4025-8b38-0ce670fddec4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.161065 Aug 01 08:02:21.788610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 163/332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:21 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:22.479319 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:22.479995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:22.486642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:22.487079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:22.487855 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:22.488282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:22.549917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:22.564785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:22.564785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:22.564785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5bf3b59a-8fbc-4f38-a0ad-fe771897cf62 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1342 microversion: 2.20 time: 0.085513 Aug 01 08:02:22.565123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 170/333] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:22 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:22.642730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:22.643350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] [instance: 74db4b58-2bc7-41c2-a1d2-c9480cc96464] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:22.650014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:22.650476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:22.651241 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:22.651717 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:22.666094 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] HTTP exception thrown: Instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 could not be found. Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Request method failure captured: Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 HTTP/1.1 Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54hAV5KZ6g4T10aTM0IB2WEvPPGzlY3L_IrOSwflEeSWprKj_gHo4WV3E3MlaeTAwg9E0M1xequqJP15ssH4WxKN-TWJgtw4d9uOZ5lqEEu6wNowa3O3fL70oIi6Xwd4-UPX3itKxIQA1nhUs1XVcm3NWzWKj1E4ZHA83Yyj27CWGhQ Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: c7089377e1ee4c64973fe9d8a1b59735 Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesActionsTest-123095958 Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:02:22.667996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7089377e1ee4c64973fe9d8a1b59735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c7089377e1ee4c64973fe9d8a1b59735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c7089377e1ee4c64973fe9d8a1b59735", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c7089377e1ee4c64973fe9d8a1b59735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesActionsTest-123095958 Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: c7089377e1ee4c64973fe9d8a1b59735 Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesActionsTest-123095958 Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesActionsTest-123095958-project Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 19c483a587bf423aaa0fdb9b4e24ce9d Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesActionsTest-123095958-project Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 could not be found. Aug 01 08:02:22.669389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '74db4b58-2bc7-41c2-a1d2-c9480cc96464'} Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 could not be found. Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:02:22.670154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 could not be found. Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 could not be found. Aug 01 08:02:22.671414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:02:22.672516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] Returning 404 to user: Instance 74db4b58-2bc7-41c2-a1d2-c9480cc96464 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:02:22.672516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7bf5dc34-e522-4829-b4c0-d4c672acec6b tempest-VolumesActionsTest-123095958 tempest-VolumesActionsTest-123095958-project] 10.222.0.48 "GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464" status: 404 len: 111 microversion: 2.1 time: 0.030589 Aug 01 08:02:22.672516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 164/334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:22 2022] GET /compute/v2.1/servers/74db4b58-2bc7-41c2-a1d2-c9480cc96464 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:02:22.810121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:22.810985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:22.817639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:22.818083 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:22.819152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:22.819784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:22.953949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:22.962263 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-73e00ea3-b7df-465e-84ff-97816a1e9cd5 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.156069 Aug 01 08:02:22.962824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 171/335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:22 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:23.583819 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:23.585000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:23.591192 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:23.591676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:23.592618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:23.593213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:23.677905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:23.681935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:23.683459 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:23.684739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8dc5a0bc-fb02-430c-8b77-26e7e0149599 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1342 microversion: 2.20 time: 0.104861 Aug 01 08:02:23.685292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 165/336] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:23 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:23.985666 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:23.986429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:23.993109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:23.993550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:23.994297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:23.994718 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:24.131379 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:24.139884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c4586d4c-7974-45e3-a554-54008c42ab59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.157978 Aug 01 08:02:24.158437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 172/337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:23 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:24.708058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:24.709348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:24.722705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:24.722705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:24.722705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:24.722705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:24.785322 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:24.791008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:24.792857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:24.793954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-183fc9f7-4f61-4c59-85d2-dd100be71d6c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1352 microversion: 2.20 time: 0.090375 Aug 01 08:02:24.794498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 166/338] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:24 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:25.160622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:25.161225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:25.167810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:25.168262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:25.169079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:25.169510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:25.298262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:25.306167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-13b9945f-86fc-445c-b261-95ee222dd929 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.149343 Aug 01 08:02:25.306715 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 173/339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:25 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:25.816315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:25.816929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:25.824302 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:25.824755 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:25.825547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:25.825990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:25.874774 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:25.886544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:25.894479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:25.896008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:25.897144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6b1ad8a3-79ec-4e0a-a8e9-017e2dbf07cd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1352 microversion: 2.20 time: 0.084706 Aug 01 08:02:25.897697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 167/340] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:25 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:26.327803 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:26.328401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:26.330227 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:26.335112 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:26.335573 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:26.336319 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:26.336747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:26.462907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:26.470382 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0a8f2909-9853-4c1d-ab0d-e7c261eeb292 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.146474 Aug 01 08:02:26.470936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 174/341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:26 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:26.919795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:26.920415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:26.927025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:26.928019 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:26.928963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:26.929403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:26.992632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:27.000617 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:27.002151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:27.003263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5b952e06-82ef-48a7-8da5-7338ddfb0358 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1352 microversion: 2.20 time: 0.088038 Aug 01 08:02:27.003848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 168/342] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:26 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:27.492504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:27.493041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:27.494890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=8 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:27.499872 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:27.500313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:27.501066 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:27.501497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:27.630802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:27.638119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-03be3aef-e43c-4ea1-9ed1-fd0d9eb18041 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.149773 Aug 01 08:02:27.638676 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 175/343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:27 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:28.026692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:28.027345 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:28.035422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:28.035922 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:28.036700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:28.037143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:28.057898 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:28.114471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:28.123132 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:28.124673 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:28.125787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-375d52bc-a07a-4c6f-b48a-0033d78cf869 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1340 microversion: 2.20 time: 0.102924 Aug 01 08:02:28.126402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 169/344] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:28 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:28.660451 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:28.660989 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:28.668055 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:28.668494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:28.669241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:28.669671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:28.795968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:28.804198 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-75018c7a-22f6-47a9-add5-eebb48affa22 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.148047 Aug 01 08:02:28.804765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 176/345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:28 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:29.150627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:29.151242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:29.157840 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:29.158292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:29.159053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:29.159488 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:29.285913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:29.294506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:29.296040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:29.297131 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-daac1b48-246a-4ab4-acaf-39ad0eca5e5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.151321 Aug 01 08:02:29.297675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 170/346] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:29 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:29.825231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:29.825834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:29.831841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:29.832315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:29.833060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:29.833554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:29.960484 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:29.968345 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-14e82ea5-6f67-45a1-9149-126ba797010d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.146960 Aug 01 08:02:29.969153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 177/347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:29 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:30.318373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:30.318914 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:30.325376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:30.325831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:30.326594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:30.327037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:30.452173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:30.460457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:30.461997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:30.465265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-64b56ba7-0424-4103-aa66-65b2534a7f2e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.148672 Aug 01 08:02:30.465265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 171/348] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:30 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:30.989490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:30.990259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:30.996088 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:30.996537 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:30.997290 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:30.997727 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:31.126949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:31.135049 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-64e89daa-5721-4ba6-ae60-79752ca23f11 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.149442 Aug 01 08:02:31.135621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 178/349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:30 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:31.485844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:31.486492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:31.493693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:31.494173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:31.494941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:31.495382 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:31.624413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:31.632763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:31.634279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:31.635430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f347d2db-66b9-4160-a95e-e65a4bc8c686 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.153498 Aug 01 08:02:31.636005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 172/350] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:31 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:32.157143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:32.157743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:32.164582 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:32.165020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:32.165760 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:32.166436 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:32.298426 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:32.305973 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ea151393-f70f-4545-8c6b-c9ea7584f4c3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.152591 Aug 01 08:02:32.306591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 179/351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:32 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:32.657876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:32.658413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:32.665205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:32.665653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:32.666705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:32.667144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:32.842329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:32.850862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:32.852425 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:32.853552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fc50ad1f-2c00-435d-bc07-20423279122e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.199745 Aug 01 08:02:32.854108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 173/352] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:32 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:33.027893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-8b2b43fa-e00f-466c-9dee-0fdd3e61a579 req-35389cbe-6a78-4523-9492-99c495547c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:33.038419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-8b2b43fa-e00f-466c-9dee-0fdd3e61a579 req-35389cbe-6a78-4523-9492-99c495547c28 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:33.038863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-8b2b43fa-e00f-466c-9dee-0fdd3e61a579 req-35389cbe-6a78-4523-9492-99c495547c28 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:33.049897 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-8b2b43fa-e00f-466c-9dee-0fdd3e61a579 req-35389cbe-6a78-4523-9492-99c495547c28 service nova] Creating event network-changed:daa76105-034d-4c5f-86e2-217a532d6cef for instance 113f63fa-4474-43ba-bbaa-75beddceb74d on hv-cinder-74014 Aug 01 08:02:33.055515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-8b2b43fa-e00f-466c-9dee-0fdd3e61a579 req-35389cbe-6a78-4523-9492-99c495547c28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031255 Aug 01 08:02:33.056123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 180/353] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:02:33.327219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:33.327858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:33.334848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:33.335303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:33.336104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:33.336544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:33.499275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:33.507440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-516b68f3-0d70-4ae3-84de-947c2580e74f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.183944 Aug 01 08:02:33.508046 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 174/354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:33 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:33.877144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:33.877889 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:33.884899 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:33.889475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:33.889475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:33.889475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:34.022862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:34.034642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:34.036269 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:34.038245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3a8fc48d-d84c-4b09-9553-db6c4f50ac26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.165403 Aug 01 08:02:34.038800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 181/355] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:33 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:34.529222 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:34.529842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:34.536438 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:34.537480 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:34.538347 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:34.538789 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:34.754110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:34.768137 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b84eb9a2-7aeb-4af2-aac3-1b6efc02f775 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1502 microversion: 2.1 time: 0.242645 Aug 01 08:02:34.768725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 175/356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:34 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:34.795555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a8d9786-efb3-4351-8102-2fb3bf43b20c"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:34.795555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:34.799495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:34.799966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:34.800729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:34.801166 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:34.829282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] HTTP exception thrown: Cannot 'attach_volume' instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 while it is in vm_state rescued Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Request method failure captured: Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/os-volume_attachments HTTP/1.1 Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 74 Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gWx0OjsQ2RLiwgJ0Jh8IQ4C1sjlFSb0jZ8QmC1E2aXvnhiXEgz_ZibRsx_B01SZHESwZ6mLLOB7ybMc4FhP2IW2X0T3cEmOv7baMLkdG0U3us5loVNJvJLPgoB_c3PlM9nu_z8P99XvhqtRAfV8OtMB0JqungL7H2ls_p6_TXd7rk Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:02:34.830967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aae673506a1a4ea2b3209c8a86b3a33b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 972bc4e9bc9e49b4a3bc2a693b05e4ab Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {"volumeAttachment": {"volumeId": "0a8d9786-efb3-4351-8102-2fb3bf43b20c"}} Aug 01 08:02:34.832494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Cannot 'attach_volume' instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 while it is in vm_state rescued Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'server_id': '90208b0f-9714-4c0b-8a4d-65014a5fbe42', 'body': {'volumeAttachment': {'volumeId': '0a8d9786-efb3-4351-8102-2fb3bf43b20c'}}} Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:02:34.833876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 while it is in vm_state rescued Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:02:34.835576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 while it is in vm_state rescued Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Returning 409 to user: Cannot 'attach_volume' instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 while it is in vm_state rescued {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a8a24f5d-ee1d-4418-9d65-8cab80538b61 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046734 Aug 01 08:02:34.842963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 182/357] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:02:34 2022] POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 08:02:34.843495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:34.843836 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:34.849935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:34.850477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:34.851318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:34.851864 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:35.035769 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bcc87612-67db-4184-a521-b8a346388651 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/action" status: 202 len: 0 microversion: 2.1 time: 0.197052 Aug 01 08:02:35.036826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 176/358] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:02:34 2022] POST /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:02:35.045711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:35.046264 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:35.053281 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:35.053816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:35.054642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:35.055077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:35.061683 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:35.063971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:35.069276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:35.069730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:35.070499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:35.070943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:35.188040 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:35.196660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1e2c10d9-4812-43b2-92b0-60e7db19bbe0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1510 microversion: 2.1 time: 0.155328 Aug 01 08:02:35.197231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 183/359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:35 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:35.210863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:35.218842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:35.220397 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:35.221547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-09e1de9a-7b70-4276-ba47-7d541478e50c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.164208 Aug 01 08:02:35.222102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 177/360] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:35 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:02:36.221357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:36.222077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:36.228752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:36.229903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:36.231012 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:36.231452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:36.244179 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:36.244856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:36.251774 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:36.252447 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:36.253633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:36.254338 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:36.447483 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:36.460603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7e63c324-6e9e-40be-a6ee-55dbc6b8eb59 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1510 microversion: 2.1 time: 0.243801 Aug 01 08:02:36.476745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 184/361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:36 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:36.542968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:36.553735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:36.555669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:36.557197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c0e60b12-5a77-405d-8b0d-bd74363291c3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.317725 Aug 01 08:02:36.558386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 178/362] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:36 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:37.484388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:37.485043 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:37.497588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:37.498031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:37.498792 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:37.499216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:37.582832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:37.584157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:37.591786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:37.592195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:37.593362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:37.594125 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:37.752469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:37.764624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-775feed1-848e-4390-a8da-61ee0e7c5115 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1510 microversion: 2.1 time: 0.281634 Aug 01 08:02:37.766717 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 185/363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:37 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:37.820283 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:37.847051 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:37.847051 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:37.847051 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-131bc035-a29f-4a12-bf25-c06bee4d0677 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.268524 Aug 01 08:02:37.847470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 179/364] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:37 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:38.794775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:38.795720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:38.811048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:38.813396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:38.819599 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:38.822953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:38.871114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:38.875269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:38.876328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:38.886057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:38.886944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:38.888955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:38.889544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:39.046176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:39.068196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-787ef32b-a264-43f5-a321-ef599c38d8f8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1510 microversion: 2.1 time: 0.282481 Aug 01 08:02:39.069425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 186/365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:38 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1510 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:39.167351 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:39.177157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:39.178674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:39.179859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-820723fc-283a-4954-9792-b33e6e4f555a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.309754 Aug 01 08:02:39.180413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 180/366] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:38 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:40.102617 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:40.105278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:40.126482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:40.127311 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:40.128690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:40.131800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:40.202897 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:40.204379 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:40.211727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:40.212795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:40.213950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:40.214692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:40.389327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:40.399018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:40.400996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:40.402316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fc9c708b-0ce1-429d-a5a3-8db4961155d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.203606 Aug 01 08:02:40.402953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 181/367] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:40 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:02:40.535608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:40.543890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6bc7870c-45d5-4b38-a11e-b4af19ae6a8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1510 microversion: 2.1 time: 0.451448 Aug 01 08:02:40.544718 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 187/368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:40 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:41.427520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:41.428415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:41.436575 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:41.437262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:41.438552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:41.439157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:41.571286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:41.572775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:41.574923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:41.584046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:41.589272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:41.590326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:41.590969 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:41.687823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:41.698355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:41.700229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:41.701447 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-44db899d-4d93-4780-a845-eab1fe221853 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.278888 Aug 01 08:02:41.702503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 182/369] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:41 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:41.923079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:41.934758 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c7fe64ff-adc5-4fb1-82c4-c7a8617c2ede tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1510 microversion: 2.1 time: 0.371771 Aug 01 08:02:41.942517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 188/370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:41 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:42.634146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-63a7a928-78f4-48fc-908b-2b2da48cc338 req-e6048a08-3947-40f4-a392-ee233db53d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "name": "network-vif-plugged", "status": "completed", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:42.672153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-63a7a928-78f4-48fc-908b-2b2da48cc338 req-e6048a08-3947-40f4-a392-ee233db53d48 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:42.672658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-63a7a928-78f4-48fc-908b-2b2da48cc338 req-e6048a08-3947-40f4-a392-ee233db53d48 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:42.687770 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-63a7a928-78f4-48fc-908b-2b2da48cc338 req-e6048a08-3947-40f4-a392-ee233db53d48 service nova] Creating event network-vif-plugged:daa76105-034d-4c5f-86e2-217a532d6cef for instance 113f63fa-4474-43ba-bbaa-75beddceb74d on hv-cinder-74014 Aug 01 08:02:42.698311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-63a7a928-78f4-48fc-908b-2b2da48cc338 req-e6048a08-3947-40f4-a392-ee233db53d48 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064924 Aug 01 08:02:42.699640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 183/371] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:02:42.732848 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:42.734135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:42.749673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:42.750388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:42.751355 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:42.751986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:42.974726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:42.976034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:43.000590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:43.000590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:43.002757 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:43.005624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:43.185145 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:43.206835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:43.209308 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:43.226202 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ad75de53-aba6-41eb-8b4d-30e5a03b89f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.499539 Aug 01 08:02:43.227372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 189/372] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:42 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:43.367388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:43.380815 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0e5807d4-05fc-42c6-8a70-fbc36a2ac45c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1516 microversion: 2.1 time: 0.411447 Aug 01 08:02:43.381616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 184/373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:42 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1516 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:44.253019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:44.254121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:44.261424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:44.268073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:44.268992 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:44.269567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:44.545760 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:44.555409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:44.563795 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:44.566864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cb3f9948-2b70-4ae0-bd34-7365ce3a5eaf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.317775 Aug 01 08:02:44.569162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 190/374] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:44 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:45.595210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:45.596733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:45.599901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:45.622492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:45.623778 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:45.624810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:45.627559 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:45.844646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:45.849280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:02:45.859414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:45.864044 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:45.868354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6bdac618-de51-4937-a427-f59e274f769b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1408 microversion: 2.20 time: 0.276434 Aug 01 08:02:45.871646 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 185/375] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:45 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:46.432763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f52eed74-b523-48de-8ca4-fc5b002ef810 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'create', calling method: .version_select at 0x7efe440935e0>, body: {"keypair": {"name": "tempest-keypair-488425694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/7TlVuEgse/tqm7ZnpyGxruC3k6TsKZqGwJbVk/9//kuYdd+59X+7qfA8a4rdyLKU279f2trVmBn9NCASpItF3VKorrmSiHPWeIaZUNkb89Dwx5Do3eWXm01Qqtij0Uw=="}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:46.471353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f52eed74-b523-48de-8ca4-fc5b002ef810 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:02:46.472223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f52eed74-b523-48de-8ca4-fc5b002ef810 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for user 972bc4e9bc9e49b4a3bc2a693b05e4ab and project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:02:46.644414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f52eed74-b523-48de-8ca4-fc5b002ef810 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.216414 Aug 01 08:02:46.645117 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 191/376] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:02:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:02:46.896145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:46.897555 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:46.924620 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:46.925670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:46.927341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:46.932148 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:47.212530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:47.222255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:47.225075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:47.229985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7b9a3d2b-c417-42d4-960f-cc32082f87ef tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1599 microversion: 2.20 time: 0.336010 Aug 01 08:02:47.229985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 186/377] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:02:46 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1599 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:02:47.254920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:47.255843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:47.266012 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:47.266923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:47.267980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:47.268857 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:47.494215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a822ea8c-3e5a-4874-9f7a-2a3174c140ed tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.243716 Aug 01 08:02:47.495129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 192/378] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 1 08:02:47 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:02:49.484654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-ade5f6e0-30d5-499d-8c33-0d60591fa3f1 req-398f8ca2-4954-493d-aae2-a25d24eb76d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:49.544166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-ade5f6e0-30d5-499d-8c33-0d60591fa3f1 req-398f8ca2-4954-493d-aae2-a25d24eb76d0 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:49.545589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-ade5f6e0-30d5-499d-8c33-0d60591fa3f1 req-398f8ca2-4954-493d-aae2-a25d24eb76d0 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:49.563982 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-ade5f6e0-30d5-499d-8c33-0d60591fa3f1 req-398f8ca2-4954-493d-aae2-a25d24eb76d0 service nova] Creating event network-changed:daa76105-034d-4c5f-86e2-217a532d6cef for instance 113f63fa-4474-43ba-bbaa-75beddceb74d on hv-cinder-74014 Aug 01 08:02:49.573419 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-ade5f6e0-30d5-499d-8c33-0d60591fa3f1 req-398f8ca2-4954-493d-aae2-a25d24eb76d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098248 Aug 01 08:02:49.574520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 187/379] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:02:50.684940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1820202888", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aefda8bc-e850-4f20-b2fd-fcc55caeafbf"}], "security_groups": [{"name": "tempest-securitygroup--280304059"}], "key_name": "tempest-keypair-488425694", "user_data": "}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:55.579194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] validate_networks() for [('aefda8bc-e850-4f20-b2fd-fcc55caeafbf', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:02:56.356909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:02:56.357339 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:02:56.357821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:02:56.358228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:02:56.358639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:02:56.369745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:56.370199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:56.371629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:56.371629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:56.394367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:02:56.399325 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Getting quotas for user 972bc4e9bc9e49b4a3bc2a693b05e4ab and project aae673506a1a4ea2b3209c8a86b3a33b. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:02:56.412432 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:02:56.415286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:02:56.625861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0dea58ca-b7c0-455e-a8b5-62605438a576 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.944034 Aug 01 08:02:56.638990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 193/380] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:02:50 2022] POST /compute/v2.1/servers => generated 408 bytes in 5960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 08:02:56.642533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b51803c0-81a7-41c9-8003-b57d85c96aa1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:56.650850 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b51803c0-81a7-41c9-8003-b57d85c96aa1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:56.785254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b51803c0-81a7-41c9-8003-b57d85c96aa1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:56.793602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b51803c0-81a7-41c9-8003-b57d85c96aa1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1245 microversion: 2.1 time: 0.155761 Aug 01 08:02:56.795886 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 188/381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:56 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1245 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:02:57.399745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f3fc63c4-3d46-4965-85c2-30775bf47033 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Action: 'create', calling method: .version_select at 0x7efe3fe21ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1537120608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBcHvAMFKV/F8o5PXCQawGqTZyajSLtIMyGqVcl5QcUuBHj4eCXn3sYBWWHN1sHbD9AxGwWZzS/2KopBELILuFQFMxy2FBY+2OSpx2JdNd3p3IaJNQiWRH1DzMGladuHw=="}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:02:57.419464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f3fc63c4-3d46-4965-85c2-30775bf47033 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for project 03212885780843bf830a8f030756db97. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:02:57.425912 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f3fc63c4-3d46-4965-85c2-30775bf47033 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for user d4d85df24c9e4312bbe2da197f55e116 and project 03212885780843bf830a8f030756db97. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:02:57.539195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f3fc63c4-3d46-4965-85c2-30775bf47033 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.509922 Aug 01 08:02:57.541880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 194/382] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:02:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:02:57.822666 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-af0cf8fc-f0f9-4971-9298-c16efedf643a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:57.823288 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-af0cf8fc-f0f9-4971-9298-c16efedf643a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:57.892948 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-af0cf8fc-f0f9-4971-9298-c16efedf643a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:57.902547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-af0cf8fc-f0f9-4971-9298-c16efedf643a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1245 microversion: 2.1 time: 0.083720 Aug 01 08:02:57.903288 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 189/383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:57 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:02:58.923581 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:02:58.924954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:02:58.932127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:58.932785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:58.933984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:02:58.934593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:02:59.042880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:02:59.062804 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ee24d242-afc8-4bdf-9014-75a48e7887af tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1297 microversion: 2.1 time: 0.142301 Aug 01 08:02:59.064470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 195/384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:02:58 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:00.085727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:00.087173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:00.091851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=8 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:00.099768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:00.100630 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:00.101809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:00.102626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:00.224442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:00.247078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ee556436-cbc9-4ac1-a48c-4446913a5cc4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1303 microversion: 2.1 time: 0.164581 Aug 01 08:03:00.251237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 190/385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:00 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1303 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:01.276412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:01.281057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:01.297610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:01.305861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:01.305861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:01.305861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:01.474105 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:01.491021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-13dec890-2000-4c5d-b3ae-71f6b3822eaa tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.219649 Aug 01 08:03:01.492383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 196/386] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:01 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:01.840551 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-407ed9b3-088d-4101-9791-68265998942a req-2b7740ac-6e02-49ff-9579-c8a015e9aed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69c65b7-c268-424b-bda1-e93e9b42732e", "tag": "575f0fe0-ae51-4fa5-8a22-b9afe5af92d1"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:03:01.852352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-407ed9b3-088d-4101-9791-68265998942a req-2b7740ac-6e02-49ff-9579-c8a015e9aed8 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:01.853064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-407ed9b3-088d-4101-9791-68265998942a req-2b7740ac-6e02-49ff-9579-c8a015e9aed8 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:01.867256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-407ed9b3-088d-4101-9791-68265998942a req-2b7740ac-6e02-49ff-9579-c8a015e9aed8 service nova] Creating event network-changed:575f0fe0-ae51-4fa5-8a22-b9afe5af92d1 for instance d69c65b7-c268-424b-bda1-e93e9b42732e on hv-cinder-74014 Aug 01 08:03:01.872664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-407ed9b3-088d-4101-9791-68265998942a req-2b7740ac-6e02-49ff-9579-c8a015e9aed8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037189 Aug 01 08:03:01.873472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 191/387] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:02.512099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:02.512716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:02.518736 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:02.519189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:02.519980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:02.523460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:02.662570 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:02.670437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1204bcbd-80f9-43fe-bf05-b6b4385a9409 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.162209 Aug 01 08:03:02.670974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 197/388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:02 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:03.694100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:03.694888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:03.702503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:03.703161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:03.704141 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:03.704755 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:03.845247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:03.853460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-06a2173e-e33b-40a6-8743-2f8a19b25c90 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.163662 Aug 01 08:03:03.854054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 192/389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:03 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:04.874398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:04.874975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:04.882102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:04.882622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:04.883482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:04.884003 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:05.021824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:05.029423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d3e2bd0a-6fad-4d19-a968-3298e0f5915f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.158994 Aug 01 08:03:05.029972 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 198/390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:04 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:03:06.050064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:06.050681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:06.057598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:06.058047 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:06.058804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:06.059236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:06.246119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:06.256342 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a7fa03af-0cbf-419c-a0c3-ee06afd16a32 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.209960 Aug 01 08:03:06.257515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 193/391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:06 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:07.277467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:07.278073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:07.279970 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:07.284953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:07.285474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:07.286814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:07.287259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:07.422702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:07.431440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2f8a7d98-4a3b-4bd6-ad8b-8ec51bce904b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.157910 Aug 01 08:03:07.432045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 199/392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:07 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:08.453367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:08.453980 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:08.456516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=4 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:08.462391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:08.462846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:08.463640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:08.464085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:08.608323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:08.616329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-71de7ad0-6f70-472f-96b1-6c812b0c4edb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.167061 Aug 01 08:03:08.616892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 194/393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:08 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:08.811710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-b4efacad-4355-46c1-99f4-cdc8a5184714 req-a4675187-a904-4005-85c8-fd1f7dd930bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69c65b7-c268-424b-bda1-e93e9b42732e", "name": "network-vif-plugged", "status": "completed", "tag": "575f0fe0-ae51-4fa5-8a22-b9afe5af92d1"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:03:08.817821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=14 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:08.823220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-b4efacad-4355-46c1-99f4-cdc8a5184714 req-a4675187-a904-4005-85c8-fd1f7dd930bc service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:08.823692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-b4efacad-4355-46c1-99f4-cdc8a5184714 req-a4675187-a904-4005-85c8-fd1f7dd930bc service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:08.835140 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-b4efacad-4355-46c1-99f4-cdc8a5184714 req-a4675187-a904-4005-85c8-fd1f7dd930bc service nova] Creating event network-vif-plugged:575f0fe0-ae51-4fa5-8a22-b9afe5af92d1 for instance d69c65b7-c268-424b-bda1-e93e9b42732e on hv-cinder-74014 Aug 01 08:03:08.840248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-b4efacad-4355-46c1-99f4-cdc8a5184714 req-a4675187-a904-4005-85c8-fd1f7dd930bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033218 Aug 01 08:03:08.840840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 200/394] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:09.636919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:09.637566 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:09.645283 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:09.645788 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:09.646511 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:09.646941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:09.783891 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:09.792501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-470f92fc-4525-4467-85aa-61decd7ce1ab tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.159427 Aug 01 08:03:09.793132 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 195/395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:09 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:10.814834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:10.815549 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:10.822783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:10.823303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:10.828743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:10.828743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:10.828981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=65 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:10.965844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:10.973398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-007d7018-be71-4d84-8c90-e8131aab585b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1370 microversion: 2.1 time: 0.163011 Aug 01 08:03:10.973843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 201/396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:10 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:11.994348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:11.994966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:12.001194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:12.002306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:12.002430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:12.002849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:12.148462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:12.157725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0e092e9d-a7d3-4a47-828b-798766fedd3b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1563 microversion: 2.1 time: 0.167326 Aug 01 08:03:12.158285 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 196/397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:11 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:12.183023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:12.183651 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:12.189802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:12.197560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:12.197560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:12.197560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:12.275545 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5ad43ae6-0888-4f1e-9254-ce119385a812 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097787 Aug 01 08:03:12.276170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 202/398] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:03:12 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:13.762021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-18461110-3d3d-460a-b1c1-f89053c6171e req-dd87c16d-dff2-4300-bd6e-7ef9e6728a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69c65b7-c268-424b-bda1-e93e9b42732e", "tag": "575f0fe0-ae51-4fa5-8a22-b9afe5af92d1"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:03:13.774017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-18461110-3d3d-460a-b1c1-f89053c6171e req-dd87c16d-dff2-4300-bd6e-7ef9e6728a33 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:13.774793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-18461110-3d3d-460a-b1c1-f89053c6171e req-dd87c16d-dff2-4300-bd6e-7ef9e6728a33 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:13.790922 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-18461110-3d3d-460a-b1c1-f89053c6171e req-dd87c16d-dff2-4300-bd6e-7ef9e6728a33 service nova] Creating event network-changed:575f0fe0-ae51-4fa5-8a22-b9afe5af92d1 for instance d69c65b7-c268-424b-bda1-e93e9b42732e on hv-cinder-74014 Aug 01 08:03:13.796263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-18461110-3d3d-460a-b1c1-f89053c6171e req-dd87c16d-dff2-4300-bd6e-7ef9e6728a33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039433 Aug 01 08:03:13.796959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 197/399] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:33.051586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=5 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:33.052361 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=9 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:33.056346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-109220179", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1537120608", "security_groups": [{"name": "tempest-secgroup-smoke-1037893150"}], "block_device_mapping_v2": [{"uuid": "ba568b6f-a434-4407-bc8b-4083793d2cda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b7cb864-a3a9-46e9-bfcd-6745f1953e1a"}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:03:33.169201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] validate_networks() for [('7b7cb864-a3a9-46e9-bfcd-6745f1953e1a', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:03:33.543208 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:03:33.543669 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:03:33.544137 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:03:33.544565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:03:33.544975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:03:33.554134 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:33.554585 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:33.556396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:33.556841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:33.575234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for project 03212885780843bf830a8f030756db97. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:03:33.579318 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for user d4d85df24c9e4312bbe2da197f55e116 and project 03212885780843bf830a8f030756db97. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:03:33.637855 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:03:33.640128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba568b6f-a434-4407-bc8b-4083793d2cda',volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:03:34.100147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4454249f-98ad-41eb-a88e-7e5abffa8a22 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.049374 Aug 01 08:03:34.101051 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 203/400] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:03:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:03:34.111890 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-13d12ac2-022a-43fc-8447-03532470456b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:34.112691 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-13d12ac2-022a-43fc-8447-03532470456b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:34.115946 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=29 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:34.118002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=40 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:34.170552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-13d12ac2-022a-43fc-8447-03532470456b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:34.177748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-13d12ac2-022a-43fc-8447-03532470456b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1094 microversion: 2.1 time: 0.069889 Aug 01 08:03:34.178330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 198/401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:34 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:35.198424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:35.198947 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:35.205128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:35.205577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:35.206334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:35.206770 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:35.267869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:35.276001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8ede5581-6c67-4844-8c8b-40d47cedd205 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1144 microversion: 2.1 time: 0.081570 Aug 01 08:03:35.276567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 204/402] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:35 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:36.296732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:36.297357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:36.304657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:36.305144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:36.306005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:36.306446 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:36.368466 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:36.375938 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9a7940a4-869d-4961-9adf-67e1856e9c4d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1192 microversion: 2.1 time: 0.083526 Aug 01 08:03:36.376519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 199/403] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:36 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:37.398287 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:37.398897 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:37.406466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:37.406933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:37.407834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:37.408497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:37.566433 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:37.575664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-61b9485d-b117-4b44-b6b9-3a2935719e18 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1278 microversion: 2.1 time: 0.181432 Aug 01 08:03:37.576355 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 205/404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:37 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:38.586835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-452fb6fc-02ac-4e6d-ba3b-429b4e0d4a2e req-69336a62-d783-4779-98ce-1d7176e3426e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbbafe5-6682-410e-957c-38e6258e5dce", "tag": "ad06e8ba-9dca-42a9-969e-d0b9311f55a3"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:03:38.596753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-452fb6fc-02ac-4e6d-ba3b-429b4e0d4a2e req-69336a62-d783-4779-98ce-1d7176e3426e service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:38.596975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:38.597408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-452fb6fc-02ac-4e6d-ba3b-429b4e0d4a2e req-69336a62-d783-4779-98ce-1d7176e3426e service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:38.598256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:38.606136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:38.606805 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:38.607889 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:38.608471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:38.609696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-452fb6fc-02ac-4e6d-ba3b-429b4e0d4a2e req-69336a62-d783-4779-98ce-1d7176e3426e service nova] Creating event network-changed:ad06e8ba-9dca-42a9-969e-d0b9311f55a3 for instance afbbafe5-6682-410e-957c-38e6258e5dce on hv-cinder-74014 Aug 01 08:03:38.615034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-452fb6fc-02ac-4e6d-ba3b-429b4e0d4a2e req-69336a62-d783-4779-98ce-1d7176e3426e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031989 Aug 01 08:03:38.615659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 200/405] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:38.767099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:38.775006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d540cf63-ee0f-486a-887c-cfbf6144e6c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.182333 Aug 01 08:03:38.775692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 206/406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:38 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:39.797629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:39.798336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:39.804565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:39.805101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:39.805867 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:39.806307 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:39.936263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:39.943750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2dd83428-c684-4f63-8666-4e005ef58383 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.150785 Aug 01 08:03:39.944312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 201/407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:39 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:40.964638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:40.965195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:40.971248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:40.971725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:40.972539 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:40.972987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:41.112719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:41.120236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e932a668-0d2c-4373-a163-bd49419cd384 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.160136 Aug 01 08:03:41.120802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 207/408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:40 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:42.141810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:42.142450 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:42.149022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:42.149670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:42.150430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:42.150942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:42.286176 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:42.294566 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a4be88cc-89a4-4681-9910-e8951a67f5c1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.156596 Aug 01 08:03:42.295127 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 202/409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:42 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:43.316235 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:43.316848 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:43.323412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:43.323880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:43.324639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:43.325077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:43.455942 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:43.463338 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-385cd8f3-a78c-4dd9-97d5-ba71d1c5de5e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.151242 Aug 01 08:03:43.464035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 208/410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:43 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:44.483805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:44.484347 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:44.486823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:44.491782 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:44.492234 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:44.492998 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:44.493438 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:44.627801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:44.635860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f470b44f-0610-4aa6-b6e5-2e763f2d4a5a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.155376 Aug 01 08:03:44.636426 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 203/411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:44 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:45.657250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:45.657924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:45.659689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:45.660482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=6 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:03:45.665482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:45.665928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:45.666827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:45.667311 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:45.803592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:45.810815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3f2b5c39-4bfd-4236-9e74-aff4f87385f1 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.157385 Aug 01 08:03:45.811374 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 209/412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:45 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:46.831617 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:46.832239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:46.839374 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:46.839845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:46.840610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:46.841051 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:46.973348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:46.981318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0701026a-5d3e-443a-95f1-cc86ee28877a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.153567 Aug 01 08:03:46.981880 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 204/413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:46 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:48.001879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:48.004998 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:48.008672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:48.009232 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:48.010689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:48.011277 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:48.141740 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:48.149171 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8881e2d7-db60-45ea-979b-ef763c596c45 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.151164 Aug 01 08:03:48.149827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 210/414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:47 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:49.170517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:49.171155 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:49.177726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:49.178261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:49.178979 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:49.179419 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:49.310861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:49.318398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0b002a14-9d9a-4383-9a10-241240a75614 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.152240 Aug 01 08:03:49.318966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 205/415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:49 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:50.339042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:50.339668 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:50.345674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:50.346121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:50.346874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:50.347307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:50.482490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:50.489854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-534e3689-b331-4879-92ec-7ebc7c811504 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.154679 Aug 01 08:03:50.490395 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 211/416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:50 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:51.510637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:51.511246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:51.517707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:51.518151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:51.518901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:51.519462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:51.649975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:51.658099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d4d65a50-a44e-4f82-90bd-9f58e3d32cc2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.151839 Aug 01 08:03:51.658659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 206/417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:51 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:51.757515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:51.758038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:51.764199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:51.764649 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:51.765411 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:51.765842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:51.789229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-be67cb07-4665-47c8-8626-9be0b582d2c3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/ips" status: 200 len: 149 microversion: 2.1 time: 0.035270 Aug 01 08:03:51.789785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 212/418] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:03:51 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:52.679757 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:52.680378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:52.687504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:52.690831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:52.690831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:52.690831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:52.823890 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:52.831329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-66744cbd-c100-4707-bdc0-47972f548f65 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.155569 Aug 01 08:03:52.831927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 207/419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:52 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:53.851467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:53.852116 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:53.858413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:53.858907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:53.859700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:53.860136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:53.992458 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:54.000489 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e643fef4-91d4-481b-b949-996d734e64b5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.152807 Aug 01 08:03:54.000986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 213/420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:53 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:55.021791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:55.022381 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:55.029670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:55.030119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:55.030880 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:55.031318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:55.159344 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:55.167371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-27fd9464-e04e-4265-b1ce-a27b9a9ae726 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.149528 Aug 01 08:03:55.167962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 208/421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:55 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:55.791297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:55.791802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:55.798063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:55.798502 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:55.799243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:55.799723 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:55.822156 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1a42324c-6171-4474-9dc0-ee22145677e5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/ips" status: 200 len: 144 microversion: 2.1 time: 0.034889 Aug 01 08:03:55.822634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 214/422] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:03:55 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/ips => generated 144 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:03:56.187956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:56.188582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:56.195057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:56.195514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:56.196304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:56.196743 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:56.331747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:56.338488 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-aa14d8dd-9ce0-458c-92ea-ea35097b0ccb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.154959 Aug 01 08:03:56.339149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 209/423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:56 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:57.359968 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:57.360576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:57.366651 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:57.372060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:57.372060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:57.372060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:57.497799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:57.506381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-596242d8-0bbb-4f1b-be8b-8ef90ec51dc9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.150829 Aug 01 08:03:57.506945 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 215/424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:57 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:58.527268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:58.527855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:58.534355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:58.534812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:58.535606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:58.536053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:58.675690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:58.683457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-01910ff6-f60d-42b9-a627-ad2baf02288b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.160108 Aug 01 08:03:58.684839 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 210/425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:58 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:03:59.704160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:03:59.704840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:59.710861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:59.711308 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:59.712106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:59.712541 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:59.822888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63ad4694-10df-4d45-a028-b2fe6c99aee2"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:03:59.825332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:03:59.831823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:59.832274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:59.833036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:03:59.833469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:03:59.850240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:03:59.858214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b0b13de3-1005-4836-b970-1831f73c9671 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.157965 Aug 01 08:03:59.858779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 216/426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:03:59 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:00.878946 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:00.879600 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:00.885562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:00.886010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:00.886770 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:00.887993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:01.027061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:01.035802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a6a913cf-e452-4b6d-8ba3-f1d398f9a5fe tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.160847 Aug 01 08:04:01.036386 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 217/427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:00 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:02.056671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:02.057281 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:02.063254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:02.063737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:02.064501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:02.064923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:02.204276 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:02.211724 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2ebca4ae-be45-40f3-b435-17f7f5bddc5d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.158928 Aug 01 08:04:02.214702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 218/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:02 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:02.217279 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-cdb6e283-e1ea-4485-bc42-ffccc5fbf316 req-e408daaf-760a-4eac-ba19-cd2cbcbb0e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbbafe5-6682-410e-957c-38e6258e5dce", "name": "network-vif-plugged", "status": "completed", "tag": "ad06e8ba-9dca-42a9-969e-d0b9311f55a3"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:02.226298 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-cdb6e283-e1ea-4485-bc42-ffccc5fbf316 req-e408daaf-760a-4eac-ba19-cd2cbcbb0e7f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:02.226732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-cdb6e283-e1ea-4485-bc42-ffccc5fbf316 req-e408daaf-760a-4eac-ba19-cd2cbcbb0e7f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:02.238224 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-cdb6e283-e1ea-4485-bc42-ffccc5fbf316 req-e408daaf-760a-4eac-ba19-cd2cbcbb0e7f service nova] Creating event network-vif-plugged:ad06e8ba-9dca-42a9-969e-d0b9311f55a3 for instance afbbafe5-6682-410e-957c-38e6258e5dce on hv-cinder-74014 Aug 01 08:04:02.243147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-cdb6e283-e1ea-4485-bc42-ffccc5fbf316 req-e408daaf-760a-4eac-ba19-cd2cbcbb0e7f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029817 Aug 01 08:04:02.243739 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 219/429] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:03.234206 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:03.234903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:03.236838 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:03.241735 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:03.242184 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:03.242940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:03.243378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:03.245926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=91 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:03.372546 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:03.379831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2ea51118-02a2-4b9e-a791-2212e65dc999 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.150414 Aug 01 08:04:03.380385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 220/430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:03 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:04.160752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7fb6a983-953b-4dfe-b95d-66c96c3108c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.341609 Aug 01 08:04:04.161534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 211/431] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:03:59 2022] POST /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments => generated 194 bytes in 4343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:04:04.400360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:04.400960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:04.407578 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:04.408023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:04.408767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:04.409193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:04.542440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:04.550727 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-71c8ed0c-8659-4ac8-9c43-f4d727c9a916 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.154168 Aug 01 08:04:04.551280 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 221/432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:04 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:05.572748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:05.574046 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:05.581686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:05.582158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:05.582928 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:05.583364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:05.724849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:05.732477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d9450aa7-5363-4f3d-9616-6abbb6c24c6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1266 microversion: 2.1 time: 0.165089 Aug 01 08:04:05.733037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 212/433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:05 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:06.753544 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:06.754152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:06.760330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:06.760778 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:06.761544 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:06.761980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:06.899138 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:06.906749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-261cf576-c3dd-4d24-b6ec-4dd9f6e96073 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1454 microversion: 2.1 time: 0.157099 Aug 01 08:04:06.907304 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 222/434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:06 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:06.931451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:06.932089 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:06.934552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=33 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:06.940061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:06.940513 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:06.941281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:06.941722 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:06.944315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:07.071310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:07.079381 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cb3eda6f-e031-4048-8cc7-6077458acede tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1454 microversion: 2.1 time: 0.151770 Aug 01 08:04:07.079977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 213/435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:06 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:09.158132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-9a818ee1-69cc-4ad5-bf9d-0ca2292be22a req-5dd990d6-998f-47bc-8ff6-ddf156222305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afbbafe5-6682-410e-957c-38e6258e5dce", "tag": "ad06e8ba-9dca-42a9-969e-d0b9311f55a3"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:09.168007 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-9a818ee1-69cc-4ad5-bf9d-0ca2292be22a req-5dd990d6-998f-47bc-8ff6-ddf156222305 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:09.170934 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-9a818ee1-69cc-4ad5-bf9d-0ca2292be22a req-5dd990d6-998f-47bc-8ff6-ddf156222305 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:09.180873 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-9a818ee1-69cc-4ad5-bf9d-0ca2292be22a req-5dd990d6-998f-47bc-8ff6-ddf156222305 service nova] Creating event network-changed:ad06e8ba-9dca-42a9-969e-d0b9311f55a3 for instance afbbafe5-6682-410e-957c-38e6258e5dce on hv-cinder-74014 Aug 01 08:04:09.185937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-9a818ee1-69cc-4ad5-bf9d-0ca2292be22a req-5dd990d6-998f-47bc-8ff6-ddf156222305 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032274 Aug 01 08:04:09.186532 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 223/436] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:09.805268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fadd287-2578-4bdb-9b49-5109adf13f55"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:09.807861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:09.816013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:09.816470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:09.817321 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:09.817788 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:10.505176 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8ab0d68a-8143-4b2a-a9a3-a33a0ab51f28 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703779 Aug 01 08:04:10.505816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 214/437] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:04:09 2022] POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:23.372764 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=7 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:23.373536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=19 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:23.377996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f1540c77-9174-4757-98bb-a28d966e03e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: .version_select at 0x7efe440f1310>, body: {"keypair": {"name": "tempest-keypair-882549185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBT/+1kdbNYxsecxM2onVgqb2T3pyBm5RiFvfxU4m3LnCECKNofLMz4x213R5o7ExZJIjeGGkzEez/aFuNFmIWH45zsQ212MjDlv4NcxjnTR0G9TkfqOJaSyGWYLARkZew=="}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:23.393762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f1540c77-9174-4757-98bb-a28d966e03e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:04:23.397536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-f1540c77-9174-4757-98bb-a28d966e03e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:04:23.525506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f1540c77-9174-4757-98bb-a28d966e03e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147274 Aug 01 08:04:23.525506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 224/438] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:04:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:25.654255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:25.655009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:25.659557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2043555894", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1c12be1-af6a-4cc8-84b7-bc9366e80977"}], "security_groups": [{"name": "tempest-securitygroup--2011470840"}], "key_name": "tempest-keypair-882549185", "user_data": "}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:25.761405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] validate_networks() for [('c1c12be1-af6a-4cc8-84b7-bc9366e80977', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:04:26.132608 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:04:26.133030 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:04:26.133567 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:04:26.133977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:04:26.134384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:04:26.143313 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:26.143791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:26.144582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:26.145013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:26.161951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:04:26.166153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:04:26.178118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:04:26.180495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:04:26.327422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-48823bdb-b01b-4dd4-840b-af52f1e2505f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.674505 Aug 01 08:04:26.328396 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 215/439] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:04:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:04:26.339725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c8fd1109-47c9-421c-907a-033a6dbc0520 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:26.340460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c8fd1109-47c9-421c-907a-033a6dbc0520 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:26.417673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c8fd1109-47c9-421c-907a-033a6dbc0520 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:26.425052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c8fd1109-47c9-421c-907a-033a6dbc0520 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1241 microversion: 2.1 time: 0.089608 Aug 01 08:04:26.427075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 225/440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:26 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:27.446878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:27.447497 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:27.455400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:27.455883 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:27.456647 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:27.457082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:27.519004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:27.526471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6e4c7cf0-c465-4c52-a29e-8b5206f2ebfe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1245 microversion: 2.1 time: 0.084027 Aug 01 08:04:27.527034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 216/441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:27 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:28.546475 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:28.547046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:28.554737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:28.555271 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:28.556056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:28.556484 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:28.618864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:28.626495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c52ca3bb-9199-48c4-bcde-91ccaee179ad tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1301 microversion: 2.1 time: 0.083908 Aug 01 08:04:28.627062 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 226/442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:28 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:29.649986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:29.650549 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:29.670481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:29.673827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:29.677168 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:29.677801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:29.944457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:29.952277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d5fdfb97-63a6-40eb-a227-7d5b598ccb3b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.306608 Aug 01 08:04:29.952927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 217/443] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:29 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:30.530572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-47576c1f-5b18-491c-a82e-50860611a0f7 req-f0535313-402f-46a8-a493-a9a816e5602f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6267fc83-1b64-48ea-85bc-2c8eb64b8505", "tag": "6eb120dc-b917-4de7-a129-a2d22d86419a"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:30.541542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-47576c1f-5b18-491c-a82e-50860611a0f7 req-f0535313-402f-46a8-a493-a9a816e5602f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:30.541982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-47576c1f-5b18-491c-a82e-50860611a0f7 req-f0535313-402f-46a8-a493-a9a816e5602f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:30.553345 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-47576c1f-5b18-491c-a82e-50860611a0f7 req-f0535313-402f-46a8-a493-a9a816e5602f service nova] Creating event network-changed:6eb120dc-b917-4de7-a129-a2d22d86419a for instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 on hv-cinder-74014 Aug 01 08:04:30.558419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-47576c1f-5b18-491c-a82e-50860611a0f7 req-f0535313-402f-46a8-a493-a9a816e5602f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033364 Aug 01 08:04:30.559008 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 227/444] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:30.977517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:30.978111 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:30.984484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:30.984933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:30.985724 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:30.986495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:31.186043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:31.194319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a1c53ea3-13a1-425c-a876-ded315a8d17d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.220563 Aug 01 08:04:31.194888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 218/445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:30 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:31.803822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a0d6fda7-bea3-4bf9-945c-66ce0a51ec0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:31.809966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a0d6fda7-bea3-4bf9-945c-66ce0a51ec0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:31.810464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a0d6fda7-bea3-4bf9-945c-66ce0a51ec0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:31.870866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a0d6fda7-bea3-4bf9-945c-66ce0a51ec0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Going to try to stop instance {{(pid=118232) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 08:04:32.085555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a0d6fda7-bea3-4bf9-945c-66ce0a51ec0f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action" status: 202 len: 0 microversion: 2.1 time: 0.285760 Aug 01 08:04:32.086081 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 228/446] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:04:31 2022] POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:04:32.100231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:32.100848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:32.107282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:32.107787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:32.108553 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:32.108991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:32.216038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:32.216835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:32.223646 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:32.224753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:32.224902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:32.225378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:32.238968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:32.247217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f6a81e2e-cac8-45b1-84b7-b761f286f8ae tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.150873 Aug 01 08:04:32.247816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 219/447] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:32 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:32.359159 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:32.367184 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-17fa9243-586a-4db9-8431-c199ec2f61fb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.155426 Aug 01 08:04:32.367825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 229/448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:32 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:33.268388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:33.268949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:33.275359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:33.275837 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:33.276599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:33.277036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:33.388175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:33.388779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:33.395025 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:33.395580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:33.396434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:33.396975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:33.408935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:33.417518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d20665af-b0db-4df9-9ab5-e40cbe698251 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.152990 Aug 01 08:04:33.418099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 220/449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:33 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:33.524216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:33.531564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7ce6fb37-0f0e-4e94-b00c-ad0eb6fbff92 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.147200 Aug 01 08:04:33.532114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 230/450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:33 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:34.439332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:34.439967 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:34.446500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:34.451278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:34.451278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:34.451278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:34.552380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:34.553588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:34.559770 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:34.560207 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:34.560984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:34.561422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:34.580428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:34.588401 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d500dd98-843d-485d-9826-a051fe0dd097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.153535 Aug 01 08:04:34.588972 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 221/451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:34 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:34.693295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:34.700891 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-53f7800d-9bd6-449c-bfde-b103f9c7affb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.152669 Aug 01 08:04:34.701449 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 231/452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:34 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:35.610020 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:35.610823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:35.617209 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:35.617705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:35.618463 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:35.618901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:35.722368 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:35.722969 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:35.731246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:35.731724 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:35.732509 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:35.733201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:35.767888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:35.776280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b5e427c7-e872-4a02-ac41-c3678b769cf9 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.170170 Aug 01 08:04:35.776933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 222/453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:35 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:35.928161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:35.935370 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-51ce7f65-ae1f-4406-aa13-513579a74bc0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.217410 Aug 01 08:04:35.935953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 232/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:35 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:36.797738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:36.798989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:36.801995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:36.802683 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:36.807204 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:36.809573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:36.809573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:36.809573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:36.960015 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:36.960935 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:36.969122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=6 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:36.974358 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:36.981706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:36.982314 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:36.983214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:36.986218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:36.999633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-097242db-cac6-43df-ad92-0334a7201a51 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.205419 Aug 01 08:04:37.000202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 223/455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:36 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:37.132471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:37.140126 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4314836e-161e-4a07-b3d4-624ee8bcdf1d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.186569 Aug 01 08:04:37.140682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 233/456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:36 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:38.021088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:38.021702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:38.028312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:38.028807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:38.029832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:38.030275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:38.162467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:38.163007 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:38.169387 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:38.169831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:38.170603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:38.171042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:38.197617 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:38.206812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d8ffd9e9-2b52-4526-b9a8-00fb47a43cfb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.189674 Aug 01 08:04:38.207388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 224/457] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:38 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:38.305169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:38.313048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-119ab630-21a2-4d4b-bd2f-7bd907930b7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.155356 Aug 01 08:04:38.313636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 234/458] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:38 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:38.547116 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-5426de95-8222-4c60-ac17-70e86ece69cd req-7b2bf5f0-4539-4cf6-90d7-90eb742ddda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6267fc83-1b64-48ea-85bc-2c8eb64b8505", "name": "network-vif-plugged", "status": "completed", "tag": "6eb120dc-b917-4de7-a129-a2d22d86419a"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:38.557800 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5426de95-8222-4c60-ac17-70e86ece69cd req-7b2bf5f0-4539-4cf6-90d7-90eb742ddda9 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:38.558373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5426de95-8222-4c60-ac17-70e86ece69cd req-7b2bf5f0-4539-4cf6-90d7-90eb742ddda9 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:38.571128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-5426de95-8222-4c60-ac17-70e86ece69cd req-7b2bf5f0-4539-4cf6-90d7-90eb742ddda9 service nova] Creating event network-vif-plugged:6eb120dc-b917-4de7-a129-a2d22d86419a for instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 on hv-cinder-74014 Aug 01 08:04:38.576536 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-5426de95-8222-4c60-ac17-70e86ece69cd req-7b2bf5f0-4539-4cf6-90d7-90eb742ddda9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Aug 01 08:04:38.577156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 225/459] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:39.228875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:39.229489 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:39.236217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:39.236521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:39.237280 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:39.237717 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:39.334876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:39.335740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:39.341892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:39.342345 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:39.343104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:39.343556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:39.365022 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:39.372922 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3e9da051-b59f-4370-bd99-0cce4bfdbaf0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.148072 Aug 01 08:04:39.373476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 235/460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:39 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:39.478580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:39.486804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e211477e-804c-4457-9683-783f82076174 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.156557 Aug 01 08:04:39.487376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 226/461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:39 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:40.395956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:40.396572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:40.403188 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:40.403667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:40.404468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:40.404922 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:40.508085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:40.508706 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:40.515109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:40.515582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:40.516355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:40.516845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:40.534788 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:40.542811 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-47ca7e2d-99b5-430b-bc03-2f9d977f118d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.151356 Aug 01 08:04:40.543385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 236/462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:40 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:40.645484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:40.652994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bc22895a-599a-4c47-9316-2100f1a23405 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1367 microversion: 2.1 time: 0.148611 Aug 01 08:04:40.653499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 227/463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:40 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:41.563922 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:41.564598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:41.570580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:41.571027 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:41.571811 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:41.572251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:41.673361 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:41.674229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:41.680669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:41.681192 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:41.682032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:41.682539 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:41.700626 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:41.709371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f0abc84b-ae84-4294-ad1f-c96e587c3400 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.149433 Aug 01 08:04:41.710168 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 237/464] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:41 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:41.811392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:41.820219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fe379dc7-9b85-4543-abc7-7cf9e407ce9e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1558 microversion: 2.1 time: 0.150656 Aug 01 08:04:41.820714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 228/465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:41 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:41.841107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:41.841599 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:41.847643 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:41.848096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:41.848879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:41.849320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:41.927729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f61320cb-23e5-4fb4-886d-1cd3a442f869 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090347 Aug 01 08:04:41.928337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 238/466] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:04:41 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:04:42.731807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:42.732363 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:42.740014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:42.740480 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:42.741265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:42.741709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:42.875621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:42.884015 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-73513e83-e65f-4e8a-9cf6-031fea2d868e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.156231 Aug 01 08:04:42.884572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 229/467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:42 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:43.135381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-335b463d-12ef-4d84-bab0-db78e41f1163 req-77ad4f0e-3f19-4446-9243-01d76b3b0fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6267fc83-1b64-48ea-85bc-2c8eb64b8505", "tag": "6eb120dc-b917-4de7-a129-a2d22d86419a"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:43.145897 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-335b463d-12ef-4d84-bab0-db78e41f1163 req-77ad4f0e-3f19-4446-9243-01d76b3b0fca service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:43.146134 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-335b463d-12ef-4d84-bab0-db78e41f1163 req-77ad4f0e-3f19-4446-9243-01d76b3b0fca service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:43.158446 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-335b463d-12ef-4d84-bab0-db78e41f1163 req-77ad4f0e-3f19-4446-9243-01d76b3b0fca service nova] Creating event network-changed:6eb120dc-b917-4de7-a129-a2d22d86419a for instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 on hv-cinder-74014 Aug 01 08:04:43.162445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-335b463d-12ef-4d84-bab0-db78e41f1163 req-77ad4f0e-3f19-4446-9243-01d76b3b0fca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030740 Aug 01 08:04:43.163026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 239/468] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:04:43.905854 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:43.906462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:43.913232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:43.913679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:43.914432 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:43.914867 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:44.051494 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:44.059432 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-27b94204-7e18-4cd8-8854-31ea0aa4b5da tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.157406 Aug 01 08:04:44.060027 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 230/469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:43 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:45.082629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:45.083323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:45.089543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:45.089989 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:45.090743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:45.091497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:45.221717 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:45.229573 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6f75c626-dcc2-4c56-aaa9-53976a41927b tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.152025 Aug 01 08:04:45.230120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 240/470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:45 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:46.252008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:46.252588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:46.258956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:46.259410 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:46.260206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:46.260685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:46.391210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:46.400234 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-92d3bb33-affc-4649-bb0f-e7af9f7846db tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.152905 Aug 01 08:04:46.400938 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 231/471] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:46 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:47.423261 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:47.423913 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:47.430225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:47.430666 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:47.431417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:47.431866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:47.557399 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:47.565592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-057e6da4-155d-45fc-8c4e-ecd5187d5c91 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.146214 Aug 01 08:04:47.566149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 241/472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:47 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:48.587099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:48.587748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:48.594350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:48.594806 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:48.595592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:48.596602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:48.724592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:48.728056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:48.732750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6249f4a9-51cc-4f28-8dd3-b90a6e5ed1c4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.149535 Aug 01 08:04:48.733303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 232/473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:48 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:49.754807 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:49.755921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:49.762154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:49.762557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:49.763306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:49.763769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:49.893621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:49.901610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ea419e16-9bb1-4195-985f-107b06df3e4a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.150695 Aug 01 08:04:49.902175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 242/474] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:49 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:50.923191 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:50.923828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:50.930391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:50.930841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:50.931630 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:50.932066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:51.061664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:51.070021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8ee2a02a-ef64-41c0-a997-822c61e4093a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.151038 Aug 01 08:04:51.070578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 233/475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:50 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:52.091987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:52.092527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:52.099344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:52.099819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:52.100583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:52.101034 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:52.105152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:52.235863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:52.244596 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a3844277-7f50-49b5-ae6c-e8283fe50161 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.156414 Aug 01 08:04:52.245163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 243/476] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:52 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:53.266166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:53.266792 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:53.273453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:53.273905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:53.274669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:53.275115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:53.402163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:53.410743 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-343be275-be9b-4f20-8caf-76766459bbfd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.148434 Aug 01 08:04:53.415986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 234/477] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:53 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:54.432270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:54.432802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:54.434655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:54.439397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:54.444791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:54.444791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:54.444791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:54.572577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:54.580449 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fa9a23a2-9dc0-4c64-9792-a93ffd433f76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.152073 Aug 01 08:04:54.581621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 244/478] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:54 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:55.603010 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:55.603829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:55.609871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:55.610315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:55.611069 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:55.611495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:55.741048 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:55.749227 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8fd5999d-4d79-4251-be34-e639dd4055fb tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1720 microversion: 2.1 time: 0.150279 Aug 01 08:04:55.749795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 235/479] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:55 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:56.771575 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:56.772313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:56.778357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:56.778800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:56.779579 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:56.780013 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:56.905864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:56.913814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-39eeba10-87f7-4be1-8e25-3fe292d535b0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1697 microversion: 2.1 time: 0.146985 Aug 01 08:04:56.914372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 245/480] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:56 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1697 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:04:56.933893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7f0e3114-3103-4488-a7e2-cafb497dea75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:04:56.936276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:04:56.941750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7f0e3114-3103-4488-a7e2-cafb497dea75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:56.942198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7f0e3114-3103-4488-a7e2-cafb497dea75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:57.004962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7f0e3114-3103-4488-a7e2-cafb497dea75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Going to try to start instance {{(pid=118233) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 08:04:57.183099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7f0e3114-3103-4488-a7e2-cafb497dea75 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action" status: 202 len: 0 microversion: 2.1 time: 0.252826 Aug 01 08:04:57.184114 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 236/481] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:04:56 2022] POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:04:57.192916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:57.194769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:57.199496 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:57.199967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:57.200763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:57.201195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:57.330915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:57.339195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ae2420e5-4bfb-4440-a20f-0dfc15c3ede5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1706 microversion: 2.1 time: 0.150790 Aug 01 08:04:57.339793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 246/482] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:57 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1706 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:58.362032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:58.362886 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:58.369643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:58.370101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:58.370866 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:58.371307 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:58.503348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:58.511816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-407646e0-63a8-49e7-af69-c58467674f99 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1706 microversion: 2.1 time: 0.154426 Aug 01 08:04:58.512394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 237/483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:58 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1706 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:04:59.533494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:04:59.534931 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:04:59.541379 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:59.541831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:59.542590 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:04:59.543027 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:04:59.675989 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:04:59.683879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b9d5a017-c680-45aa-92b3-29a63d249cdf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1710 microversion: 2.1 time: 0.154256 Aug 01 08:04:59.684434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 247/484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:04:59 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:05:21.648355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:05:21.648978 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Mon Aug 1 08:05:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:05:24.969898 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:24.970558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:24.973056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:24.973717 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:24.978502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:24.988150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:24.988150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:24.988150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:25.003794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ef7b04fe-a9c2-41de-aeeb-d179c234a97a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/ips" status: 200 len: 150 microversion: 2.20 time: 0.037809 Aug 01 08:05:25.004409 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 238/485] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 1 08:05:24 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:05:28.211195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:05:28.211752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:28.213775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=7 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:28.214427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=28 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:28.219298 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:28.221876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:28.221876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:28.221876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:28.243122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lazy-loading 'flavor' on Instance uuid 113f63fa-4474-43ba-bbaa-75beddceb74d {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:05:28.904008 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1a019cc9-f471-414e-ac7b-112696e3b594 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/action" status: 202 len: 0 microversion: 2.20 time: 0.697164 Aug 01 08:05:28.904586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 248/486] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 08:05:28 2022] POST /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/action => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:05:28.914363 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:28.914995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:28.922668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:28.923120 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:28.923992 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:28.924435 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:29.156618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:29.165355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:29.167149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:29.168332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-37addd4c-9b21-4125-a493-837798cbcd19 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.259313 Aug 01 08:05:29.168879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 239/487] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:28 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:30.192062 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:30.192757 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:30.199021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:30.199464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:30.200239 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:30.200669 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:30.328608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:30.336411 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:30.337885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:30.339011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ce299282-989e-47c3-98cc-eedfa2e79659 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.151854 Aug 01 08:05:30.339566 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 249/488] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:30 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:31.361964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:31.362576 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:31.369731 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:31.370178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:31.370937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:31.371371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:31.495736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:31.503564 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:31.508581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:31.508581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5009a140-8129-4253-bb50-04a84cfca40d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.148180 Aug 01 08:05:31.508581 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 240/489] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:31 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:32.529094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:32.529753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:32.536577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:32.537017 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:32.537763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:32.538189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:32.668191 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:32.676020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:32.677592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:32.678734 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-15cd3cab-b201-442b-a872-b684a3c91699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.153632 Aug 01 08:05:32.679292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 250/490] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:32 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:33.352022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdba1521-140c-415c-b6ce-a2cfee9618c9"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:05:33.354416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:33.360384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:33.360833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:33.361607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:33.362043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:33.701867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:33.702471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:33.708767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:33.709207 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:33.710058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:33.710504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:33.844868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:33.853560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:33.855060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:33.856235 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1f8a1ae5-84a9-48db-8fdf-436d044213c5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.158445 Aug 01 08:05:33.856786 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 251/491] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:33 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:05:34.093794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-21ac4999-d228-4fdd-9e53-23d843a52dbb tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846935 Aug 01 08:05:34.094454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 241/492] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:05:33 2022] POST /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:05:34.878403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:34.879013 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:34.885075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:34.885525 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:34.886278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:34.886716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:35.017063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:35.025568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:35.027050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:35.028233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e5c64b7d-6281-4f13-8c26-5685c955160d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.153942 Aug 01 08:05:35.028780 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 252/493] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:34 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:36.053452 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:36.062014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:36.062014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:36.062014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:36.062014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:36.062399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:36.190463 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:36.198638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:36.200163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:36.201310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8d84d7b7-2951-43c4-bb34-31cbf7fd0003 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.152993 Aug 01 08:05:36.201853 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 242/494] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:36 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:37.225139 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:37.225765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:37.231726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:37.232164 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:37.232906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:37.233332 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:37.360025 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:37.368321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:37.369798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:37.370930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0714f9b3-b7a0-4927-a5ce-6a97188007c7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.150237 Aug 01 08:05:37.371476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 253/495] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:37 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:38.393679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:38.394235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:38.400846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:38.401300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:38.402067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:38.402508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:38.532730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:38.541599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:38.543082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:38.544269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7322bd00-4d2d-4cc1-a974-6dae8a216d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.154571 Aug 01 08:05:38.544817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 243/496] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:38 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:05:39.567083 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:39.567697 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:39.573715 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:39.574153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:39.574895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:39.575323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:39.701777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:39.709502 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:39.710975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:39.712149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-58bfb8fa-faa9-4417-9fa4-32cc5f173de7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.148874 Aug 01 08:05:39.712731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 254/497] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:39 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:40.743653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:40.744237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:40.750845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:40.751781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:40.752551 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:40.752995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:40.882510 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:40.890435 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:40.891988 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:40.893208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b0b39ae2-e8e8-4e77-8ebb-58c8fbfcc1f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.153621 Aug 01 08:05:40.893761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 244/498] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:40 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:41.916936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:41.917561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:41.923615 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:41.924054 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:41.924830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:41.925249 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:42.057816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:42.065950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:42.067448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:42.068831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5ddfffe9-06d1-4b30-8c2a-f9d9fc94ac43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.155913 Aug 01 08:05:42.069392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 255/499] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:41 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:42.666569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:05:42.668918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:42.675359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:42.675842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:42.676594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:42.677025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:42.698966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'flavor' on Instance uuid d69c65b7-c268-424b-bda1-e93e9b42732e {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:05:43.025485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-011c34eb-f015-4949-b859-6e9bba46d6b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/action" status: 200 len: 32 microversion: 2.1 time: 0.363501 Aug 01 08:05:43.026092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 245/500] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:05:42 2022] POST /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:05:43.035683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:43.036267 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:43.042849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:43.043294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:43.044095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:43.044532 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:43.092080 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:43.093351 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:43.099001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:43.099451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:43.100459 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:43.100901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:43.180069 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:43.188255 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-29b65067-fa0a-480d-878e-0de9cb54c471 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.156471 Aug 01 08:05:43.189615 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 256/501] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:43 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:43.327355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:43.335520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:43.337061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:43.338231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-39d37806-fe43-44fc-9e0c-fdb9a16acf0c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.250422 Aug 01 08:05:43.338787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 246/502] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:43 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:05:44.210703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:44.211248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:44.217245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:44.217691 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:44.218448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:44.218880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:44.347074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:44.355109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-81a1c243-bfbe-4d0d-95cb-0fa173fb9e84 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.149143 Aug 01 08:05:44.355697 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 257/503] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:44 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:44.361292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:44.362434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:44.369440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:44.369895 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:44.370657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:44.371096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:44.501069 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:44.509720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:44.511677 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:44.512845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-53620893-9bc6-4403-a6e9-c4519461f715 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.155450 Aug 01 08:05:44.513402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 247/504] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:44 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:45.377360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:45.377973 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:45.384667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:45.385117 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:45.385876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:45.386326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:45.513487 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:45.522074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f0e0ad87-20a2-4ea2-a366-c37f456028a1 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.147920 Aug 01 08:05:45.522635 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 258/505] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:45 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:45.535402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:45.536037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:45.542679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:45.543117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:45.543892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:45.544326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:45.674599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:45.682863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:45.684431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:45.685602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-72c47843-1116-4adc-aa22-f80033e438d4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.154235 Aug 01 08:05:45.686157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 248/506] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:45 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:46.544163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:46.544703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:46.550525 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:46.550966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:46.551740 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:46.552211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:46.679469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:46.687351 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7b13bd4f-8230-4e99-82ab-58e5148984c4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.147420 Aug 01 08:05:46.687949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 259/507] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:46 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:46.708939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:46.709595 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:46.716154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:46.716600 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:46.717358 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:46.717796 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:46.845113 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:46.853827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:46.855345 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:46.856623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2bc442a1-fed1-4f98-97f8-98fc921fc5d8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1744 microversion: 2.20 time: 0.152007 Aug 01 08:05:46.857183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 249/508] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:46 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:47.708172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:47.708953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:47.714748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:47.715185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:47.715965 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:47.716392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:47.853988 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:47.862189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-981b0ef6-67db-45c1-ba47-587e5470815f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.157724 Aug 01 08:05:47.862752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 260/509] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:47 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:47.880393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:47.881594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:47.888065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:47.888508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:47.889259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:47.889688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:48.021854 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:48.029947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:48.032260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:48.032610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-238228c4-bec6-4cc2-a8ea-e0755476c593 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1744 microversion: 2.20 time: 0.157007 Aug 01 08:05:48.033182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 250/510] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:47 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:48.885683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:48.886291 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:48.892383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:48.892897 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:48.893725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:48.894223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:49.024073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:49.032056 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-510b120c-b389-4cda-bb37-c20bbea4aa56 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.150285 Aug 01 08:05:49.032628 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 261/511] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:48 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:49.058503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:49.059186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:49.065694 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:49.066177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:49.066960 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:49.067400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:49.086825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:49.200441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:49.208502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:49.210343 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:49.211591 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c48fd053-79d8-472f-8be9-4bb2f9d5e699 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1744 microversion: 2.20 time: 0.157125 Aug 01 08:05:49.212129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 251/512] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:49 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:50.054384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:50.054930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:50.061186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:50.061641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:50.062504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:50.062958 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:50.081505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:50.194183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:50.202234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-83f1cae3-4838-4248-9904-354630b902f4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.151920 Aug 01 08:05:50.202789 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 262/513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:50 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:50.234904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:50.235514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:50.242700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:50.243149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:50.243938 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:50.244375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:50.369585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:50.377610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:50.379117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:50.380303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dbe505cc-f6ee-45be-a35e-297f56ce88e1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1744 microversion: 2.20 time: 0.149645 Aug 01 08:05:50.381505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 252/514] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:50 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:50.835836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-af1ba6d7-30bf-4486-bda5-30528238c397 req-9a41b6fc-487a-482e-9cf9-263149486470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "name": "network-vif-plugged", "status": "completed", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:05:50.845187 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-af1ba6d7-30bf-4486-bda5-30528238c397 req-9a41b6fc-487a-482e-9cf9-263149486470 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:50.845637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-af1ba6d7-30bf-4486-bda5-30528238c397 req-9a41b6fc-487a-482e-9cf9-263149486470 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:50.857296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-af1ba6d7-30bf-4486-bda5-30528238c397 req-9a41b6fc-487a-482e-9cf9-263149486470 service nova] Creating event network-vif-plugged:daa76105-034d-4c5f-86e2-217a532d6cef for instance 113f63fa-4474-43ba-bbaa-75beddceb74d on hv-cinder-74014 Aug 01 08:05:50.863350 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-af1ba6d7-30bf-4486-bda5-30528238c397 req-9a41b6fc-487a-482e-9cf9-263149486470 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030241 Aug 01 08:05:50.863350 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 263/515] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:05:51.225069 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:51.225624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:51.231643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:51.232093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:51.232847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:51.233285 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:51.365334 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:51.373142 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fdab84e9-ad25-40c2-9a6c-89f0b25f7fbf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.152605 Aug 01 08:05:51.373703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 253/516] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:51 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:51.404542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:51.405209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:51.411257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:51.411772 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:51.412512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:51.412936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:51.539653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:51.547814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:51.549310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:51.550461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-01045c64-930d-4d3f-93ce-1ece015c3572 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1744 microversion: 2.20 time: 0.150673 Aug 01 08:05:51.551018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 264/517] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:51 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:52.394235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:52.394827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:52.401179 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:52.401626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:52.402378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:52.402808 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:52.530459 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:52.539097 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8c18eedb-20ef-4a03-bc14-72786e090262 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.148734 Aug 01 08:05:52.539697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 254/518] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:52 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:52.573485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:52.574090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:52.580069 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:52.580516 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:52.581272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:52.581706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:52.711213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:52.719001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:52.720530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:52.721680 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b8688ea2-ef81-4ec1-ab5c-1a5119f23657 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1744 microversion: 2.20 time: 0.152009 Aug 01 08:05:52.722230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 265/519] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:52 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:53.561068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:53.561727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:53.568509 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:53.568965 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:53.569737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:53.570180 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:53.706017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:53.714715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0ccdfa0d-254d-4905-b896-33c68a1711fe tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.157484 Aug 01 08:05:53.723879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 255/520] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:53 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:53.745123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:53.745814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:53.752015 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:53.752459 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:53.753215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:53.753642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:53.897070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:53.905524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:53.907009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:53.908216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-749abf95-ec39-44da-ac67-d62abb6b0c26 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.166982 Aug 01 08:05:53.908762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 266/521] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:53 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:54.736888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:54.738105 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:54.745685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:54.746236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:54.747066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:54.747587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:54.900716 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:54.909265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-62388929-cb50-4441-b01b-02249a6e6530 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.176341 Aug 01 08:05:54.923788 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 256/522] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:54 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:54.937105 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:54.937704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:54.944955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:54.945653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:54.946605 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:54.947220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:55.083142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:55.091780 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:55.093699 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:55.095505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0ec48103-e02d-4b48-84fb-29e98b1d8137 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.161899 Aug 01 08:05:55.095960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 267/523] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:54 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:05:55.931151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:55.931788 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:55.934073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=39 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:55.939521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:55.939990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:55.940752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:55.941187 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:56.092053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:56.101697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7eff8616-a1dd-44ec-bff4-d93e3aa50532 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.174526 Aug 01 08:05:56.115899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 257/524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:55 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:56.123211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:56.124073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:56.132874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:56.134405 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:56.135309 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:56.135845 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:56.315603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:56.324808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:56.326371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:56.327795 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e0ff7c86-6ca0-4948-bcd4-eff0262c4fa1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.209201 Aug 01 08:05:56.328552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 268/525] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:56 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:57.123628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:57.124249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:57.131104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:57.131637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:57.132408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:57.132847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:57.275029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:57.283874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-444f3d2e-cc33-4726-a2b6-999400dd685d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.163906 Aug 01 08:05:57.284669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 258/526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:57 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:57.352605 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:57.353154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:57.359320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:57.359793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:57.360544 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:57.360975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:57.502037 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:57.510363 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:57.511952 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:57.513102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c3a43af7-02ce-4d8a-932a-290b2bf9cf59 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.165093 Aug 01 08:05:57.513649 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 269/527] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:57 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:58.306377 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:58.306998 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:58.313607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:58.314056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:58.314823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:58.315265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:58.447219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:58.455091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-57133567-6285-455a-8575-006411e4d621 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1734 microversion: 2.1 time: 0.153265 Aug 01 08:05:58.455676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 259/528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:58 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:05:58.537445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:58.538306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:58.541402 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=45 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:05:58.546790 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:58.547242 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:58.548059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:58.548498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:58.681382 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:58.691019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:58.691019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:58.692205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-03c8434c-ffdf-4458-9fca-175aea67f990 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.159381 Aug 01 08:05:58.692793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 270/529] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:58 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:59.477373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:59.478726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:59.486747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.487320 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.488284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.488803 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.667955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:59.680853 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a405ae27-95c6-4058-b08e-0d0295a6a5cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1714 microversion: 2.1 time: 0.207942 Aug 01 08:05:59.696159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 260/530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:05:59 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1714 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:05:59.719934 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:59.721940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:59.729578 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.730502 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.731668 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.732554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.747293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:05:59.747863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:59.761829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.762361 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.763408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.765514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.905871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:59.922703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] HTTP exception thrown: Cannot 'detach_volume' instance d69c65b7-c268-424b-bda1-e93e9b42732e while it is in vm_state rescued Aug 01 08:05:59.923622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Request method failure captured: Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments/bdba1521-140c-415c-b6ce-a2cfee9618c9 HTTP/1.1 Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gWx0OjsQ2RLiwgJ0Jh8IQ4C1sjlFSb0jZ8QmC1E2aXvnhiXEgz_ZibRsx_B01SZHESwZ6mLLOB7ybMc4FhP2IW2X0T3cEmOv7baMLkdG0U3us5loVNJvJLPgoB_c3PlM9nu_z8P99XvhqtRAfV8OtMB0JqungL7H2ls_p6_TXd7rk Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:05:59.925430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aae673506a1a4ea2b3209c8a86b3a33b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 972bc4e9bc9e49b4a3bc2a693b05e4ab Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:05:59.927556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Cannot 'detach_volume' instance d69c65b7-c268-424b-bda1-e93e9b42732e while it is in vm_state rescued Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'server_id': 'd69c65b7-c268-424b-bda1-e93e9b42732e', 'id': 'bdba1521-140c-415c-b6ce-a2cfee9618c9'} Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d69c65b7-c268-424b-bda1-e93e9b42732e in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:05:59.936330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d69c65b7-c268-424b-bda1-e93e9b42732e while it is in vm_state rescued Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d69c65b7-c268-424b-bda1-e93e9b42732e while it is in vm_state rescued Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:05:59.937607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Returning 409 to user: Cannot 'detach_volume' instance d69c65b7-c268-424b-bda1-e93e9b42732e while it is in vm_state rescued {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:05:59.938645 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ea76a00f-1161-4deb-bd40-e3bf2fad47cc tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments/bdba1521-140c-415c-b6ce-a2cfee9618c9" status: 409 len: 152 microversion: 2.1 time: 0.185060 Aug 01 08:05:59.938748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:05:59.938748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-87c727c3-42c9-4f63-be35-2224b34e29fb tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.217937 Aug 01 08:05:59.938748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 271/531] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:05:59 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:05:59.938996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 261/532] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:05:59 2022] DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments/bdba1521-140c-415c-b6ce-a2cfee9618c9 => generated 152 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 08:05:59.939430 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:05:59.939916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:05:59.946225 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.946680 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:05:59.947445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:05:59.947906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:00.162809 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5036dda8-93f5-479c-bc3b-c40f96f0ca8d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "POST /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/action" status: 202 len: 0 microversion: 2.1 time: 0.227230 Aug 01 08:06:00.163875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 272/533] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:05:59 2022] POST /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:00.173681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:00.174562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:00.185292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:00.186030 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:00.186828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:00.187268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:00.490020 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:00.501909 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-594f1f82-a2ac-4826-969e-b3ef8f093e9f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1722 microversion: 2.1 time: 0.332741 Aug 01 08:06:00.502725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 262/534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:00 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:00.958376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:00.959167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:00.968772 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:00.969489 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:00.970441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:00.972553 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:01.140882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:01.154439 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:01.155956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:01.157335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c6cabc43-38dd-4dde-a629-45525378817c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.204976 Aug 01 08:06:01.157887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 273/535] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:00 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:01.525540 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:01.526166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:01.542070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:01.542070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:01.542070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:01.542070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:01.682356 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:01.690441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d898522a-b079-4f70-a858-01d7bf411ae0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1722 microversion: 2.1 time: 0.169740 Aug 01 08:06:01.690999 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 263/536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:01 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:02.183182 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:02.183825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:02.190403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:02.190930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:02.191802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:02.192484 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:02.350831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:02.358190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:02.359807 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:02.361094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-de8047cc-a07c-4331-a1c5-5733dc4715db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.181817 Aug 01 08:06:02.368844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 274/537] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:02 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:02.712364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:02.712981 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:02.719698 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:02.720256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:02.721098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:02.721610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:02.861931 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:02.870894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1c0c8fac-3bf0-41b4-aae1-fc2577a18a96 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1722 microversion: 2.1 time: 0.162463 Aug 01 08:06:02.871678 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 264/538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:02 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:03.385963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:03.386868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:03.392954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:03.393726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:03.394161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:03.394596 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:03.535018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:03.543824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:03.545366 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:03.546536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-89bf7819-3353-47db-9473-9f7b7187779b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.164440 Aug 01 08:06:03.547087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 275/539] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:03 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:03.893412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:03.894660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:03.901986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:03.903651 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:03.904446 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:03.904893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:04.088697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:04.105786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9fc5f2b4-aebb-451a-b805-8492b8d080d0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1722 microversion: 2.1 time: 0.216285 Aug 01 08:06:04.120072 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 265/540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:03 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:06:04.569671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:04.570568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:04.577273 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:04.577725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:04.578492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:04.578918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:04.722124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:04.731152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:04.732798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:04.733955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d18712c3-285c-4588-9882-305a9939d2f3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.168634 Aug 01 08:06:04.734731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 276/541] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:04 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:05.128089 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:05.134458 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:05.135804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:05.136251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:05.137003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:05.137433 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:05.265050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:05.273206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f7196642-c864-4364-9a82-c0d3e53dd1ee tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1728 microversion: 2.1 time: 0.148899 Aug 01 08:06:05.273766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 266/542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:05 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:05.294069 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:05.294574 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:05.300551 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:05.300993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:05.301740 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:05.302170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:05.379714 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8ceb059d-33a4-4016-a4d3-acdc706e82ac tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089650 Aug 01 08:06:05.380425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 277/543] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:06:05 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:05.758590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:05.761378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:05.768848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:05.770693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:05.776760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:05.776760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:06.010851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:06.019859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:06.021569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:06.022811 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0a83c4bc-93d4-4459-b3d7-f557fb9a4197 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.268343 Aug 01 08:06:06.023373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 267/544] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:05 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:06.776503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-ac77a191-6430-40f0-8ff3-ee7d6c3c594b req-1a4a65d5-1091-46d6-9734-0de26c1a8dae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69c65b7-c268-424b-bda1-e93e9b42732e", "tag": "575f0fe0-ae51-4fa5-8a22-b9afe5af92d1"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:06.785801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-ac77a191-6430-40f0-8ff3-ee7d6c3c594b req-1a4a65d5-1091-46d6-9734-0de26c1a8dae service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:06.786243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-ac77a191-6430-40f0-8ff3-ee7d6c3c594b req-1a4a65d5-1091-46d6-9734-0de26c1a8dae service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:06.798291 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-ac77a191-6430-40f0-8ff3-ee7d6c3c594b req-1a4a65d5-1091-46d6-9734-0de26c1a8dae service nova] Creating event network-changed:575f0fe0-ae51-4fa5-8a22-b9afe5af92d1 for instance d69c65b7-c268-424b-bda1-e93e9b42732e on hv-cinder-74014 Aug 01 08:06:06.803437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-ac77a191-6430-40f0-8ff3-ee7d6c3c594b req-1a4a65d5-1091-46d6-9734-0de26c1a8dae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098561 Aug 01 08:06:06.804062 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 278/545] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:07.046599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:07.054209 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:07.054962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:07.055416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:07.056221 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:07.056660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:07.060807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:07.220009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:07.228085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:07.229594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:07.230750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-20d64e7a-44fe-4b3e-a3f0-38b10d16e0d2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1739 microversion: 2.20 time: 0.188131 Aug 01 08:06:07.231310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 268/546] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:07 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:08.254602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:08.255233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:08.262244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:08.262679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:08.263418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:08.263873 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:08.391795 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:08.395218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:08.400445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:08.401938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:08.403241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b64d63c8-d013-444c-9d96-6aa49ac47fe4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1721 microversion: 2.20 time: 0.152912 Aug 01 08:06:08.403845 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 279/547] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:08 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:08.817119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-eee7512b-2970-47b9-8937-8e4b568e74a2 req-8752f5d5-5391-4adb-a60e-17aabfea3745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d69c65b7-c268-424b-bda1-e93e9b42732e", "tag": "575f0fe0-ae51-4fa5-8a22-b9afe5af92d1"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:08.827133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-eee7512b-2970-47b9-8937-8e4b568e74a2 req-8752f5d5-5391-4adb-a60e-17aabfea3745 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:08.827600 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-eee7512b-2970-47b9-8937-8e4b568e74a2 req-8752f5d5-5391-4adb-a60e-17aabfea3745 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:08.838360 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-eee7512b-2970-47b9-8937-8e4b568e74a2 req-8752f5d5-5391-4adb-a60e-17aabfea3745 service nova] Creating event network-changed:575f0fe0-ae51-4fa5-8a22-b9afe5af92d1 for instance d69c65b7-c268-424b-bda1-e93e9b42732e on hv-cinder-74014 Aug 01 08:06:08.843231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-eee7512b-2970-47b9-8937-8e4b568e74a2 req-8752f5d5-5391-4adb-a60e-17aabfea3745 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029695 Aug 01 08:06:08.843847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 269/548] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:09.425833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:09.426440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:09.433373 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:09.433821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:09.434587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:09.435021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:09.568714 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:09.576737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:09.578304 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:09.579581 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d31505fb-eb8c-4fe4-ba3b-14ed8bef4bc4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1721 microversion: 2.20 time: 0.157970 Aug 01 08:06:09.580215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 280/549] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:09 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:10.603778 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:10.604833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:10.611129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:10.611606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:10.612385 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:10.612829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:10.746684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:10.758749 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:10.760302 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:10.761565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-efcc2b3e-2522-4388-9460-dd9c89e71c0b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1664 microversion: 2.20 time: 0.162870 Aug 01 08:06:10.762336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 270/550] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:10 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:10.784404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3e5e6ea-a718-435a-8cf3-4f40bf18d035"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:10.786773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:10.793688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:10.794233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:10.795011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:10.795445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:10.911353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-a8905b71-6771-4545-9c56-5bd1c14caafd req-b0998cac-2faa-42a4-9ec9-4a8dce3ce2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "name": "network-vif-unplugged", "status": "completed", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:10.921579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-a8905b71-6771-4545-9c56-5bd1c14caafd req-b0998cac-2faa-42a4-9ec9-4a8dce3ce2f2 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:10.922029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-a8905b71-6771-4545-9c56-5bd1c14caafd req-b0998cac-2faa-42a4-9ec9-4a8dce3ce2f2 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:10.934085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.compute.server_external_events [req-a8905b71-6771-4545-9c56-5bd1c14caafd req-b0998cac-2faa-42a4-9ec9-4a8dce3ce2f2 service nova] Unable to find a host for instance 113f63fa-4474-43ba-bbaa-75beddceb74d. Dropping event network-vif-unplugged {{(pid=118233) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 08:06:10.934970 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-a8905b71-6771-4545-9c56-5bd1c14caafd req-b0998cac-2faa-42a4-9ec9-4a8dce3ce2f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086493 Aug 01 08:06:10.935570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 271/551] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 88 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 08:06:11.738344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e993de2b-23ec-4005-bf7b-e9fd3000110e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.957884 Aug 01 08:06:11.739170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 281/552] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 1 08:06:10 2022] POST /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments => generated 188 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:06:11.862292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:11.862892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:11.869360 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:11.869815 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:11.870607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:11.871047 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:11.957950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118233) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 08:06:12.244596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-78cd55e1-6fdf-4dde-be3f-439274f7ae6d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/action" status: 202 len: 0 microversion: 2.20 time: 0.386687 Aug 01 08:06:12.245199 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 272/553] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 08:06:11 2022] POST /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:06:12.253444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:12.254044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:12.261236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:12.261658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:12.262448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:12.262876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:12.394742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:12.403834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:12.409133 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:12.410827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-501276f1-cbed-4cb2-87eb-4b2ab6a128f4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1750 microversion: 2.20 time: 0.161220 Aug 01 08:06:12.411441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 282/554] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:12 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:13.435272 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:13.435919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:13.442452 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:13.442907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:13.443707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:13.444149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:13.576058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:13.584416 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:13.586521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:13.587720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-38715658-74bd-4801-ac02-a1b8152dd800 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1750 microversion: 2.20 time: 0.156487 Aug 01 08:06:13.588273 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 273/555] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:13 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:14.610304 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:14.610933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:14.617947 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:14.618392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:14.619153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:14.619606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:14.751893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:14.761063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:14.762831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:14.764106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a5f2eab6-615a-4b72-9d81-04659761f497 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1752 microversion: 2.20 time: 0.157667 Aug 01 08:06:14.764566 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 283/556] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:14 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:15.787253 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:15.787976 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:15.794821 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:15.795260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:15.796050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:15.796485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:16.038460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:16.047833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:16.049336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:16.050561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7f59f9c3-8510-4004-a049-369e67d0212a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.267105 Aug 01 08:06:16.051120 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 274/557] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:15 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:17.074440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:17.075052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:17.081310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:17.082120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:17.083150 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:17.083842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:17.238481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:17.248419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:17.250161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:17.251429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d3e8810c-c48d-4d43-8671-b9f367e0491e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.180822 Aug 01 08:06:17.252422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 284/558] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:17 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:18.276953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:18.277749 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:18.284469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:18.284912 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:18.285674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:18.286099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:18.416474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:18.425320 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:18.426824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:18.428026 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4f82cc3c-a043-4d1f-b0b8-6c3f80fd58e6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.155683 Aug 01 08:06:18.428655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 275/559] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:18 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:19.451400 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:19.452113 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:19.458655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:19.459101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:19.460387 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:19.460816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:19.597427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:19.606305 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:19.607852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:19.617839 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-65ca6440-bf0e-4976-8853-d364bac2931e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.170333 Aug 01 08:06:19.618579 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 285/560] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:19 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:20.642074 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:20.642745 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:20.650481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:20.650936 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:20.651749 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:20.652190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:20.799243 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:20.808197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:20.809932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:20.811255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-90c9bb6b-ac7d-4847-adef-0220986ee830 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.173118 Aug 01 08:06:20.811924 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 276/561] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:20 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:21.836113 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:21.836785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:21.842978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:21.843425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:21.844220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:21.844660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:21.982879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:21.991384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:21.993099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:21.994254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-36abb904-64ff-4c46-9706-91edb9693e74 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.162803 Aug 01 08:06:21.995009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 286/562] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:21 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:23.017983 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:23.018652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:23.026606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:23.027060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:23.027879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:23.028318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:23.169681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:23.179310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:23.180841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:23.182018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-25b43722-da3a-4188-bc10-f23d8aa56326 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.168238 Aug 01 08:06:23.182574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 277/563] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:23 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:23.998458 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:23.999006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:24.004911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:24.005349 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:24.006092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:24.006543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:24.136672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lazy-loading 'services' on Instance uuid 6f414074-c855-47d5-b2f8-ed5bb4b20b50 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:06:24.204400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:24.205013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:24.211905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:24.212358 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:24.213140 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:24.213580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:24.368140 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:24.376968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:24.378446 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:24.379660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-55e44106-b70a-4adf-b0ab-5e26aba1a243 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.179184 Aug 01 08:06:24.380219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 278/564] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:24 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:24.403001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-daddf005-2ec0-4eaa-a59c-914e2d494333 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-volume_attachments/3fadd287-2578-4bdb-9b49-5109adf13f55" status: 202 len: 0 microversion: 2.1 time: 0.516100 Aug 01 08:06:24.403716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 287/565] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:06:23 2022] DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-volume_attachments/3fadd287-2578-4bdb-9b49-5109adf13f55 => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:25.404040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:25.404688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:25.411830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:25.412287 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:25.413098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:25.413541 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:25.554190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:25.562618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:25.564138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:25.565292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-02bb9be2-6a65-4602-9500-d51f9afbff43 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.165378 Aug 01 08:06:25.565868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 279/566] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:25 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:26.599840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:26.599840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:26.599840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:26.599840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:26.601075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:26.601075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:26.739882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:26.749256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:26.750739 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:26.751960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f74aabbb-2d08-403f-9438-633fdfce4d5c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.165937 Aug 01 08:06:26.752539 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 288/567] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:26 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:27.882658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:27.882658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:27.882658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:27.882658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:27.884045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:27.884045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:27.884045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:27.923403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:27.932400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:27.933945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:27.935144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-519e5658-3807-4a3b-96e0-9f94fd19ffba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.163741 Aug 01 08:06:27.935723 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 280/568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:27 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:28.959121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:28.959820 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:28.966221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:28.966657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:28.967399 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:28.967860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:29.098055 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:29.106502 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:29.108071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:29.109213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cb112267-3702-4371-93d5-9d0ae532579d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.154000 Aug 01 08:06:29.109763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 289/569] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:28 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:30.131182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:30.132006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:30.139299 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:30.139782 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:30.140561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:30.141004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:30.271245 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:30.280335 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:30.281842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:30.283012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-069605c7-0e9f-4766-9140-6c5b0dd289db tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.155651 Aug 01 08:06:30.283578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 281/570] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:30 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:31.306519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:31.307058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:31.309030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=40 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:31.313993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:31.314435 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:31.315185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:31.315648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:31.443175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:31.451869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:31.453335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:31.454458 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4b939eca-90f5-4614-bbac-acd722b67aab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.152155 Aug 01 08:06:31.455009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 290/571] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:31 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:32.478610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:32.479224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:32.485686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:32.486137 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:32.486895 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:32.487332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:32.613919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:32.622498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:32.624082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:32.625243 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2bef8546-7ae6-491e-9892-c83e0c4f399b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.151647 Aug 01 08:06:32.625830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 282/572] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:32 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:33.649584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:33.650343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:33.656443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:33.656958 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:33.657728 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:33.658299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:33.804655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:33.813461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:33.815260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:33.816115 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-11cb5a87-67c0-4144-b69e-8db2bf3b2955 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.171182 Aug 01 08:06:33.831842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 291/573] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:33 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:34.000323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7b79b9f7-65b7-4db3-99e6-65b80e1bc86a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:34.007477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b79b9f7-65b7-4db3-99e6-65b80e1bc86a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:34.008122 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b79b9f7-65b7-4db3-99e6-65b80e1bc86a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:34.029902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7b79b9f7-65b7-4db3-99e6-65b80e1bc86a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Going to try to stop instance {{(pid=118233) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 08:06:34.199832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7b79b9f7-65b7-4db3-99e6-65b80e1bc86a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action" status: 202 len: 0 microversion: 2.1 time: 0.203210 Aug 01 08:06:34.200445 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 283/574] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:06:33 2022] POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:34.208469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:34.209063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:34.215521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:34.216058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:34.216806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:34.217230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:34.343447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:34.351421 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-972954f5-e973-4590-8a4f-36e2ecb53f2d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.146710 Aug 01 08:06:34.352009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 292/575] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:34 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:34.840833 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:34.841537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:34.847816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:34.848263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:34.849014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:34.849451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:34.854239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:34.986320 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:34.994830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:34.996367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:34.997543 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cd77a488-96ea-406c-a60d-17fe1ac8d2dd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.161120 Aug 01 08:06:34.998126 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 284/576] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:34 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:35.372902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:35.373517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:35.379660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:35.380101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:35.380876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:35.381300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:35.386057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:35.508563 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:35.515884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-00521ccc-9544-43a0-b0b8-f13a2dc6b5f2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.146749 Aug 01 08:06:35.516437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 293/577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:35 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:36.021451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:36.021997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:36.028991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:36.029447 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:36.030242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:36.030690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:36.157435 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:36.168670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:36.171476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:36.173746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cc3a0bee-28d3-4140-9499-3bbe0e17ee6b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.155734 Aug 01 08:06:36.174674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 285/578] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:36 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:36.536939 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:36.537536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:36.543800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:36.544241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:36.544984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:36.545409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:36.675216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:36.683452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0bfe70e5-14d1-4a40-b909-6e3accf16b89 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.150283 Aug 01 08:06:36.684040 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 294/579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:36 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:37.199373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:37.200014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:37.206484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:37.206935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:37.207736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:37.208175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:37.338056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:37.346386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:37.347905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:37.349061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a5bc7485-2784-4a1b-8aa2-4f3dd8f2f138 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.153668 Aug 01 08:06:37.349605 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 286/580] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:37 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:37.704593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:37.705204 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:37.711691 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:37.712143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:37.712909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:37.713327 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:37.839922 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:37.847300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-490d9848-59d5-44ed-baac-9360862e5cc5 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.146562 Aug 01 08:06:37.847915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 295/581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:37 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:38.372341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:38.372959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:38.379384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.379866 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.380631 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.381070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.506329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:38.515811 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:38.517304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:38.518444 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-82025664-d84d-417c-b1f3-6f515d5ae1f8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.149997 Aug 01 08:06:38.519001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 287/582] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:38 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:38.865144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:38.865835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:38.870691 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:38.871445 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:38.871994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.872443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.873210 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.873648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.877520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.877972 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.878735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.879171 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.898164 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-88565a25-5327-425a-a391-898cf17c4863 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/ips" status: 200 len: 150 microversion: 2.1 time: 0.137002 Aug 01 08:06:38.898849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 296/583] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:06:38 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/ips => generated 150 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:38.911103 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63ad4694-10df-4d45-a028-b2fe6c99aee2"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:38.914284 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:38.920566 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.921021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:38.921791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:38.922228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.004343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Invalid volume: volume 63ad4694-10df-4d45-a028-b2fe6c99aee2 is already attached to instances: 518e1fe8-c4a4-4e72-9984-324ab59f6683 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: POST /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/os-volume_attachments HTTP/1.1 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 74 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:06:39.006038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {"volumeAttachment": {"volumeId": "63ad4694-10df-4d45-a028-b2fe6c99aee2"}} Aug 01 08:06:39.008454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Invalid volume: volume 63ad4694-10df-4d45-a028-b2fe6c99aee2 is already attached to instances: 518e1fe8-c4a4-4e72-9984-324ab59f6683 Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'server_id': '6267fc83-1b64-48ea-85bc-2c8eb64b8505', 'body': {'volumeAttachment': {'volumeId': '63ad4694-10df-4d45-a028-b2fe6c99aee2'}}} Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 63ad4694-10df-4d45-a028-b2fe6c99aee2 is already attached to instances: 518e1fe8-c4a4-4e72-9984-324ab59f6683 Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:39.009533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 63ad4694-10df-4d45-a028-b2fe6c99aee2 is already attached to instances: 518e1fe8-c4a4-4e72-9984-324ab59f6683 Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:39.011023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:39.012618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:39.012618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:06:39.012618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:06:39.012618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 63ad4694-10df-4d45-a028-b2fe6c99aee2 is already attached to instances: 518e1fe8-c4a4-4e72-9984-324ab59f6683 Aug 01 08:06:39.012618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:39.012618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 400 to user: Invalid volume: volume 63ad4694-10df-4d45-a028-b2fe6c99aee2 is already attached to instances: 518e1fe8-c4a4-4e72-9984-324ab59f6683 {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:06:39.013474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:39.013598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8e31b27b-68de-449e-8271-03c4a7c5fe5c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105043 Aug 01 08:06:39.013598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 297/584] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:06:38 2022] POST /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 08:06:39.018534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-53151156-224d-45d8-aa8a-75cda2ce3df3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.151754 Aug 01 08:06:39.019098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 288/585] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:38 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:06:39.021320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:39.021823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:39.029063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:39.029547 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.030306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:39.031113 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.056692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:06:39.255658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d466ed1c-c335-4d43-8e16-1c8d30181f8a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 204 len: 0 microversion: 2.1 time: 0.237925 Aug 01 08:06:39.256235 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 298/586] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:06:39 2022] DELETE /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 08:06:39.265167 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:39.265715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:39.271633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:39.272474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.272939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:39.273372 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.400823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:39.408307 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-37147e94-6fc9-4254-a9a6-0350b24d758c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1682 microversion: 2.1 time: 0.147063 Aug 01 08:06:39.408868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 289/587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:39 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:39.542836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:39.543461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:39.549698 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:39.550133 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.550875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:39.551296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:39.683613 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:39.691987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:39.693477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:39.694685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7ecbdf5c-4595-4876-989f-1ca77da95d48 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.156889 Aug 01 08:06:39.695236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 299/588] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:39 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:40.040682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:40.041300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:40.047354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:40.048347 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:40.048949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:40.049391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:40.176761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:40.184193 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ed5f1429-c342-49ff-be4b-93e9470d5b21 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.148129 Aug 01 08:06:40.184762 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 290/589] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:40 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:40.430102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:40.430710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:40.436846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:40.437295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:40.438050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:40.438488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:40.567469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:40.575517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6bfa469d-8625-4dfb-a9fc-ce803b0c8413 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1682 microversion: 2.1 time: 0.149393 Aug 01 08:06:40.576090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 300/590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:40 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:40.718090 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:40.718652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:40.725008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:40.725448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:40.726228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:40.726774 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:40.856865 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:40.865388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:40.867567 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:40.868741 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e76905a3-c533-4d1c-9529-8676d8c7f5b1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.154627 Aug 01 08:06:40.869306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 291/591] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:40 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:41.219917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:41.219917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:41.219917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:41.219917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:41.220266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:41.220266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:41.342115 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:41.349556 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e0024384-588c-4a81-abea-0d41d6eac7d1 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.147605 Aug 01 08:06:41.350142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 301/592] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:41 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:41.597139 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:41.597681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:41.604167 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:41.604611 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:41.605401 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:41.605861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:41.892080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:41.892726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:41.899212 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:41.899700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:41.900480 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:41.900935 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:42.037644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:42.046733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:42.048512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:42.049528 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:42.049982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d40c3f41-8653-4d22-b17b-c5dd9474f769 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.161686 Aug 01 08:06:42.050240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 302/593] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:41 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:42.058316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-19005e2f-9fcd-44cc-9bc6-e96b622d9b14 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1682 microversion: 2.1 time: 0.465064 Aug 01 08:06:42.060536 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 292/594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:41 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1682 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:42.370876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:42.371462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:42.377548 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:42.378006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:42.378799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:42.379236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:42.509674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:42.517021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-faeff2a5-9f61-4d95-866f-cb04ee3662ad tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.150605 Aug 01 08:06:42.517580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 303/595] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:42 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:42.881658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-41e84dfd-1ca4-49b3-bcb6-c570c877c49d req-98974e8f-e63f-4f18-9b95-acba7af23b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6267fc83-1b64-48ea-85bc-2c8eb64b8505", "name": "network-vif-deleted", "tag": "6eb120dc-b917-4de7-a129-a2d22d86419a"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:42.894984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-41e84dfd-1ca4-49b3-bcb6-c570c877c49d req-98974e8f-e63f-4f18-9b95-acba7af23b17 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:42.895437 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-41e84dfd-1ca4-49b3-bcb6-c570c877c49d req-98974e8f-e63f-4f18-9b95-acba7af23b17 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:42.907793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-41e84dfd-1ca4-49b3-bcb6-c570c877c49d req-98974e8f-e63f-4f18-9b95-acba7af23b17 service nova] Creating event network-vif-deleted:6eb120dc-b917-4de7-a129-a2d22d86419a for instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 on hv-cinder-74014 Aug 01 08:06:42.912960 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-41e84dfd-1ca4-49b3-bcb6-c570c877c49d req-98974e8f-e63f-4f18-9b95-acba7af23b17 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034879 Aug 01 08:06:42.914255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 293/596] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:43.074241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:43.075668 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:43.081427 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:43.082145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:43.084357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.085074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.086769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.088168 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.105377 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.105643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.106323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.114767 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.239860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:43.251445 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-51e8285b-b9ff-4ae9-9555-788d7101c83c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 200 len: 1326 microversion: 2.1 time: 0.174890 Aug 01 08:06:43.251999 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 294/597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:43 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:43.279671 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-cdaef3e7-5642-448d-a684-4f156263af0d req-ec063c99-0f70-4827-a6d0-b63c9c20a6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "name": "network-vif-plugged", "status": "completed", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:43.290601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-cdaef3e7-5642-448d-a684-4f156263af0d req-ec063c99-0f70-4827-a6d0-b63c9c20a6b0 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.291052 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-cdaef3e7-5642-448d-a684-4f156263af0d req-ec063c99-0f70-4827-a6d0-b63c9c20a6b0 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.307247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-cdaef3e7-5642-448d-a684-4f156263af0d req-ec063c99-0f70-4827-a6d0-b63c9c20a6b0 service nova] Creating event network-vif-plugged:daa76105-034d-4c5f-86e2-217a532d6cef for instance 113f63fa-4474-43ba-bbaa-75beddceb74d on hv-cinder-74014 Aug 01 08:06:43.307472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:43.312505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-cdaef3e7-5642-448d-a684-4f156263af0d req-ec063c99-0f70-4827-a6d0-b63c9c20a6b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036576 Aug 01 08:06:43.313107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 295/598] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:06:43.318932 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:43.321343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:43.322762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f3b56df9-5226-440d-b667-edfae17d6b28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.254000 Aug 01 08:06:43.323310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 304/599] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:43 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:43.539101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:43.540112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:43.546912 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.547499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.548667 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:43.549208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:43.715812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:43.723996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cc380913-4252-4de5-b798-aacb1744db30 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1674 microversion: 2.1 time: 0.189261 Aug 01 08:06:43.727579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 296/600] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:43 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:44.273340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:44.274014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:44.280668 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:44.281112 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:44.282349 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:44.282652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:44.297099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 HTTP/1.1 Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:06:44.299776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:06:44.301409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '6267fc83-1b64-48ea-85bc-2c8eb64b8505'} Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:06:44.302215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:06:44.303414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:06:44.305360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:06:44.305360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5b7a67f9-5ae9-441c-a4b8-234c08a2987f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 404 len: 111 microversion: 2.1 time: 0.032176 Aug 01 08:06:44.305360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 305/601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:44 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:06:44.311835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c18270ac-bd41-4b12-8d01-3341a96688fc tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '.version_select at 0x7efe3f52b670>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:44.346682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:44.347301 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:44.354275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:44.354721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:44.355504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:44.355963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:44.423793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c18270ac-bd41-4b12-8d01-3341a96688fc tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882549185" status: 202 len: 0 microversion: 2.1 time: 0.116087 Aug 01 08:06:44.424602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 297/602] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 08:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882549185 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:44.555688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:44.564946 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:44.566503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:44.567882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-15fc5af8-c121-4585-a01c-9c172738c44f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.225350 Aug 01 08:06:44.568419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 306/603] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:44 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:44.747194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:44.750444 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:44.754906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:44.755364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:44.756429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:44.756884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:44.982245 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:44.991102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-29b7843e-9e66-4be4-b5d5-2c2d5c2c3fe0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1651 microversion: 2.1 time: 0.248024 Aug 01 08:06:44.992038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 298/604] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:44 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1651 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:45.011639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fe6b2584-d921-4dd9-a77b-85df45d9822f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:45.020834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fe6b2584-d921-4dd9-a77b-85df45d9822f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.026731 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fe6b2584-d921-4dd9-a77b-85df45d9822f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.058053 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fe6b2584-d921-4dd9-a77b-85df45d9822f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Going to try to start instance {{(pid=118232) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 08:06:45.253808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fe6b2584-d921-4dd9-a77b-85df45d9822f tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action" status: 202 len: 0 microversion: 2.1 time: 0.246094 Aug 01 08:06:45.254437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 307/605] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:06:45 2022] POST /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:45.263166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:45.263804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:45.274330 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.274785 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.275648 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.276065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.467478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:45.475340 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-40e655df-4127-40b9-a01d-e20013d9fc16 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1660 microversion: 2.1 time: 0.216450 Aug 01 08:06:45.475982 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 299/606] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:45 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1660 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:45.507898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:45.508595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:45.514686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.515132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.515916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.516354 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.520180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:45.592842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:45.593464 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:45.597360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lazy-loading 'services' on Instance uuid 518e1fe8-c4a4-4e72-9984-324ab59f6683 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:06:45.599599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.600062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.600892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.601329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.736188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:45.746129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:45.747690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:45.748872 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-19e082d0-3b68-4f7a-bf0d-68f7c3643f05 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.160114 Aug 01 08:06:45.759855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 300/607] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:45 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:06:45.810519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-136f993e-5857-494b-bac8-f66ca11bb86e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments/63ad4694-10df-4d45-a028-b2fe6c99aee2" status: 202 len: 0 microversion: 2.1 time: 0.307250 Aug 01 08:06:45.811508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 308/608] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:06:45 2022] DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments/63ad4694-10df-4d45-a028-b2fe6c99aee2 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:45.820906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:45.823280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:45.829545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.829993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.830760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:45.831195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:45.867556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cd2f529f-7fd9-479c-a05e-af80278209ae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051514 Aug 01 08:06:45.868138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 301/609] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:06:45 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:46.497165 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:46.497866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:46.504178 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:46.504624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:46.505420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:46.506114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:46.638506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:46.646063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-012ebbe4-f0d1-407a-ae5d-cb5f393fd0bf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1660 microversion: 2.1 time: 0.153061 Aug 01 08:06:46.646573 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 309/610] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:46 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1660 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:06:46.773561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:46.774383 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:46.780887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:46.781337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:46.782102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:46.782538 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:46.880634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:46.883580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:46.897108 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:46.899490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:46.903095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:46.903823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:46.936221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cd6289d5-edd2-4e53-b0f3-f15936d07b01 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059913 Aug 01 08:06:46.938375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 310/611] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:06:46 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:46.977971 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:46.986629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:46.988169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:46.989362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c6b03bec-35a6-402a-8ece-232845db38f0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1808 microversion: 2.20 time: 0.220233 Aug 01 08:06:46.989921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 302/612] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:46 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:47.668519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:47.669127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:47.676010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:47.676501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:47.677264 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:47.678068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:47.815551 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:47.823254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-af8ca744-088d-41dd-b3a2-f2c0de3e8c9c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1660 microversion: 2.1 time: 0.158738 Aug 01 08:06:47.823892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 311/613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:47 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1660 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:06:47.949955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:47.952249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:47.958673 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:47.959125 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:47.959923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:47.961020 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:47.964760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:47.990293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-98418d47-683c-454e-acc5-a0af45b5520e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044405 Aug 01 08:06:47.990904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 303/614] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:06:47 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:06:48.012539 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:48.013071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:48.019142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.019767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.020532 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.020963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.056627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:48.057118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:48.063276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.063755 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.064520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.065046 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.089855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:06:48.153316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:48.164687 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:48.166236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:48.169842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1e97cb9a-5d17-4e72-a68c-eeaad90fa01d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1795 microversion: 2.20 time: 0.158832 Aug 01 08:06:48.169842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 312/615] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:06:48 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:06:48.345094 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c864ce54-21fc-4860-9502-81928b6735a0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 204 len: 0 microversion: 2.1 time: 0.292330 Aug 01 08:06:48.345598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 304/616] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:06:48 2022] DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 08:06:48.353821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:48.354424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:48.360446 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.360884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.361657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.362080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.487052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:48.494722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-629423c1-2bc6-45ad-9caf-c08fc6f3ef55 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1679 microversion: 2.1 time: 0.144804 Aug 01 08:06:48.495286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 313/617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:48 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:48.845093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:48.845789 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:48.852195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.852649 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.853424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:48.853866 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:48.983155 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:48.990577 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-006dd8ea-7daa-4848-a25b-df4f6b635b55 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1664 microversion: 2.1 time: 0.149686 Aug 01 08:06:48.991134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 305/618] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:48 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:49.516429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:49.517036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:49.523052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:49.523457 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:49.524254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:49.524717 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:49.658864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:49.667048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f8574b4f-3d4b-48a0-9fa5-8002193f6d7c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1679 microversion: 2.1 time: 0.154404 Aug 01 08:06:49.667765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 314/619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:49 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:50.289580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-d9828bcf-794f-42ab-99d7-7e2319a99551 req-23dd34b4-ad9c-43e4-975b-cf7c163b5dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518e1fe8-c4a4-4e72-9984-324ab59f6683", "name": "network-vif-deleted", "tag": "08766321-ade9-4163-8a76-f1980b912511"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:50.300142 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-d9828bcf-794f-42ab-99d7-7e2319a99551 req-23dd34b4-ad9c-43e4-975b-cf7c163b5dc4 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:50.300674 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-d9828bcf-794f-42ab-99d7-7e2319a99551 req-23dd34b4-ad9c-43e4-975b-cf7c163b5dc4 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:50.314281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-d9828bcf-794f-42ab-99d7-7e2319a99551 req-23dd34b4-ad9c-43e4-975b-cf7c163b5dc4 service nova] Creating event network-vif-deleted:08766321-ade9-4163-8a76-f1980b912511 for instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 on hv-cinder-74014 Aug 01 08:06:50.319797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-d9828bcf-794f-42ab-99d7-7e2319a99551 req-23dd34b4-ad9c-43e4-975b-cf7c163b5dc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Aug 01 08:06:50.320727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 306/620] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:50.689038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:50.689623 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:50.696337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:50.696782 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:50.697608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:50.697991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:50.728769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:50.729210 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:50.729656 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lazy-loading 'fault' on Instance uuid 518e1fe8-c4a4-4e72-9984-324ab59f6683 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:06:50.771391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:50.779552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d18c0ad4-807c-4d5a-82c4-279d4c7adb6e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 200 len: 1330 microversion: 2.1 time: 0.094317 Aug 01 08:06:50.780136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 315/621] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:50 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:50.960856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:50.961642 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:50.968342 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:50.968766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:50.969542 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:50.970009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:50.995479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:06:51.251288 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-17107e6a-3c19-4da7-aef6-a4864f853d83 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "DELETE /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 204 len: 0 microversion: 2.1 time: 0.294548 Aug 01 08:06:51.252227 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 307/622] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:06:50 2022] DELETE /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:06:51.260801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:51.261525 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:51.267801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:51.268251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:51.269006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:51.269440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:51.401551 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:51.410077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3f7a62c4-d623-4651-af6d-0b406003dbff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1578 microversion: 2.1 time: 0.153596 Aug 01 08:06:51.410645 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 316/623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:51 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:51.801623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:51.802334 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:51.809005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:51.809462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:51.810231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:51.810735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:51.823989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 HTTP/1.1 Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:06:51.825621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:06:51.827093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '518e1fe8-c4a4-4e72-9984-324ab59f6683'} Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:06:51.828781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:06:51.830237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:51.831515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:06:51.831515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7de7adac-6311-4204-a3e4-22f427b52e00 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 404 len: 111 microversion: 2.1 time: 0.030028 Aug 01 08:06:51.831515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 308/624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:51 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:06:51.836391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e8bcaeff-c3af-47fc-bf74-e9212c7b9f6b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '.version_select at 0x7efe3f56f550>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:51.891213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e8bcaeff-c3af-47fc-bf74-e9212c7b9f6b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938853357" status: 202 len: 0 microversion: 2.1 time: 0.059009 Aug 01 08:06:51.891801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 317/625] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 08:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938853357 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:06:52.433874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:52.434529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:52.440496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:52.440959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:52.441735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:52.442241 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:52.578913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:52.586616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bc24747c-ad48-4002-830b-60227c29f54e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1578 microversion: 2.1 time: 0.156614 Aug 01 08:06:52.587183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 309/626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:52 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:52.761141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fa623ae9-f13a-49ae-8002-8789be69794e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: .version_select at 0x7efe3f54e1f0>, body: {"keypair": {"name": "tempest-keypair-1495958062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG97WKmq6kHdVClIl/rsM/0lRbmYKsyzuH4HcqhfrDJHYGUUt7Qyx1acmGnf/ntWcv8sjpwP3gCiZUtJFU02f5A2nfrPHahYS3nP07nmsA4sCBLHGymK/1Zdt34tTI/vZw=="}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:52.776940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-fa623ae9-f13a-49ae-8002-8789be69794e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:06:52.780892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-fa623ae9-f13a-49ae-8002-8789be69794e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:06:52.857519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fa623ae9-f13a-49ae-8002-8789be69794e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100370 Aug 01 08:06:52.858190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 318/627] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:06:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:53.607591 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:53.608316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:53.614877 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:53.615332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:53.616127 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:53.617154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:53.782615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:53.791096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-aa5de0e4-efec-4a2e-a85c-ab16d2c89fa2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1578 microversion: 2.1 time: 0.186931 Aug 01 08:06:53.795398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 310/628] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:53 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:54.318275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-6bbba325-9d0a-4f41-b552-edfa9bd4e136 req-c5360b24-8999-4d1d-9cd2-104282978da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afbbafe5-6682-410e-957c-38e6258e5dce", "name": "network-vif-deleted", "tag": "ad06e8ba-9dca-42a9-969e-d0b9311f55a3"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:54.330334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-6bbba325-9d0a-4f41-b552-edfa9bd4e136 req-c5360b24-8999-4d1d-9cd2-104282978da7 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:54.330957 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-6bbba325-9d0a-4f41-b552-edfa9bd4e136 req-c5360b24-8999-4d1d-9cd2-104282978da7 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:54.342737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-6bbba325-9d0a-4f41-b552-edfa9bd4e136 req-c5360b24-8999-4d1d-9cd2-104282978da7 service nova] Creating event network-vif-deleted:ad06e8ba-9dca-42a9-969e-d0b9311f55a3 for instance afbbafe5-6682-410e-957c-38e6258e5dce on hv-cinder-74014 Aug 01 08:06:54.348219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-6bbba325-9d0a-4f41-b552-edfa9bd4e136 req-c5360b24-8999-4d1d-9cd2-104282978da7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034474 Aug 01 08:06:54.351620 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 319/629] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:06:54.813905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:54.815431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:54.831087 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:54.831569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:54.832797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:54.833426 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:54.871718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:54.872444 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:54.872908 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lazy-loading 'fault' on Instance uuid afbbafe5-6682-410e-957c-38e6258e5dce {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:06:54.923625 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:54.932997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f2538c5a-e5c7-41e8-b412-1dbafe10dfbb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 200 len: 1230 microversion: 2.1 time: 0.123245 Aug 01 08:06:54.934110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 311/630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:54 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 1230 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:55.532667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-301641367", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1c12be1-af6a-4cc8-84b7-bc9366e80977"}], "security_groups": [{"name": "tempest-securitygroup--1591478286"}], "key_name": "tempest-keypair-1495958062", "user_data": "}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:55.636672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] validate_networks() for [('c1c12be1-af6a-4cc8-84b7-bc9366e80977', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:06:55.954505 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:55.955129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:55.962119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:55.962773 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:55.963571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:55.964038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:55.977520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] HTTP exception thrown: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Request method failure captured: Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce HTTP/1.1 Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54ineqrYuyD7yb8UESEVVpEg3zcnJg3W2c2BQkl7IzRsZGdIMJZl4VrLv-Vw8w71XJTTOTPzOY3n3zUDypIgwagOvIEzZ7z42Sig_nPsF5x-F0z9bC1FUBrVjrkFIYfrSjBhIMrnRNutt70-5Z0zoqXhbahtP61Qt5ZERdYG1wRLsTU Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 03212885780843bf830a8f030756db97 Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:06:55.979025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03212885780843bf830a8f030756db97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03212885780843bf830a8f030756db97", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-TestVolumeBootPattern-853309660 Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 03212885780843bf830a8f030756db97 Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: d4d85df24c9e4312bbe2da197f55e116 Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:06:55.980657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': 'afbbafe5-6682-410e-957c-38e6258e5dce'} Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:06:55.981589 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:06:55.983906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:06:55.985328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Returning 404 to user: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:06:55.985328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4a764d6a-3d2c-4433-869d-0768d9dc9ca3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 404 len: 111 microversion: 2.1 time: 0.029890 Aug 01 08:06:55.985328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 312/631] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:55 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 08:06:56.055690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:06:56.056142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:06:56.056611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:06:56.057063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:06:56.057455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:06:56.066095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:56.066755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:56.067602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:56.068043 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:56.083219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1127360711", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1537120608", "security_groups": [{"name": "tempest-secgroup-smoke-1037893150"}], "block_device_mapping_v2": [{"uuid": "ba568b6f-a434-4407-bc8b-4083793d2cda", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b7cb864-a3a9-46e9-bfcd-6745f1953e1a"}]}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:06:56.086020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:06:56.090094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:06:56.101375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:06:56.104061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:06:56.197560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] validate_networks() for [('7b7cb864-a3a9-46e9-bfcd-6745f1953e1a', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:06:56.244829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1ccb46ba-55d7-4834-ac03-ebe6496ff24a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.716951 Aug 01 08:06:56.245662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 320/632] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:06:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:06:56.256610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-eb72367d-93c6-43a2-9da1-68284e611680 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:56.257285 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-eb72367d-93c6-43a2-9da1-68284e611680 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:56.264305 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:56.310883 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-eb72367d-93c6-43a2-9da1-68284e611680 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:56.317658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-eb72367d-93c6-43a2-9da1-68284e611680 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1241 microversion: 2.1 time: 0.064799 Aug 01 08:06:56.318224 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 321/633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:56 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:06:56.564271 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:06:56.564692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:06:56.565161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:06:56.565661 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:06:56.566069 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:06:56.574764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:56.575205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:56.576022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:56.576463 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:56.592876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for project 03212885780843bf830a8f030756db97. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:06:56.596681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for user d4d85df24c9e4312bbe2da197f55e116 and project 03212885780843bf830a8f030756db97. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:06:56.652394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:06:56.654456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba568b6f-a434-4407-bc8b-4083793d2cda',volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:06:57.069229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d8f43f12-9c25-4512-b34c-17a0c870ba6f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.989754 Aug 01 08:06:57.070737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 313/634] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:06:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 08:06:57.081263 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7b9e260b-853a-41bd-be72-ed070176a45e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:57.081874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7b9e260b-853a-41bd-be72-ed070176a45e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:57.153026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7b9e260b-853a-41bd-be72-ed070176a45e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:57.159687 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7b9e260b-853a-41bd-be72-ed070176a45e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1095 microversion: 2.1 time: 0.082218 Aug 01 08:06:57.160247 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 322/635] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:57 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:57.339204 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ac692737-9c38-4d54-b2e0-575e9d19318e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:57.340080 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ac692737-9c38-4d54-b2e0-575e9d19318e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:57.342172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:06:57.399055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ac692737-9c38-4d54-b2e0-575e9d19318e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:57.406763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ac692737-9c38-4d54-b2e0-575e9d19318e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1241 microversion: 2.1 time: 0.072268 Aug 01 08:06:57.407480 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 314/636] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:57 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:58.180991 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-30c25833-edb6-4633-a346-3c424c434320 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:58.182020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-30c25833-edb6-4633-a346-3c424c434320 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:58.236068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-30c25833-edb6-4633-a346-3c424c434320 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:58.243437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-30c25833-edb6-4633-a346-3c424c434320 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1095 microversion: 2.1 time: 0.067204 Aug 01 08:06:58.244026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 323/637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:58 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:58.427950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:58.428628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:58.440404 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:58.440404 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:58.440404 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:58.440404 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:58.500245 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:58.507639 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8d024fbf-b620-402d-bc5e-409246462b22 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1245 microversion: 2.1 time: 0.083473 Aug 01 08:06:58.508195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 315/638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:58 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:59.264076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3411235a-5b4d-487f-8a13-85809612c6d5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:59.264683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3411235a-5b4d-487f-8a13-85809612c6d5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:59.317377 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3411235a-5b4d-487f-8a13-85809612c6d5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:59.325237 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3411235a-5b4d-487f-8a13-85809612c6d5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1095 microversion: 2.1 time: 0.065019 Aug 01 08:06:59.325791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 324/639] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:59 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:06:59.528981 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:06:59.529699 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:06:59.536272 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:59.536897 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:59.537652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:06:59.538083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:06:59.599669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:06:59.607167 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-afe4a6d3-9cb2-42f0-a394-cc904e82beaa tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1237 microversion: 2.1 time: 0.082050 Aug 01 08:06:59.607764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 316/640] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:06:59 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:00.351882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:00.352465 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:00.359002 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:00.359452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:00.360244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:00.360965 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:00.427939 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:00.437567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4dfb4ec7-5256-483b-9a18-34954bb72d40 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1137 microversion: 2.1 time: 0.089514 Aug 01 08:07:00.451035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 325/641] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:00 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1137 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:00.629654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:00.630271 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:00.637739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:00.638192 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:00.638965 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:00.639403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:00.712128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:00.719626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-16991744-3ef9-49f8-92ea-9465fe99d95f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1299 microversion: 2.1 time: 0.094416 Aug 01 08:07:00.720188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 317/642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:00 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:01.462632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:01.463244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:01.469418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:01.469846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:01.470819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:01.471261 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:01.547417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:01.558595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1892068d-c986-43cb-bcde-76bae164f47a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1211 microversion: 2.1 time: 0.100157 Aug 01 08:07:01.560142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 326/643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:01 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:01.749826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:01.750536 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:01.757736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:01.758277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:01.759212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:01.759693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:02.090459 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:02.098626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0ebfb070-a630-4d69-9b13-45612e01102c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.352744 Aug 01 08:07:02.099219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 318/644] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:01 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:02.434584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-da284aa7-6ca8-4025-903a-05e67bc7dc81 req-7f573808-6098-401f-9cf2-e4f499e7f722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108bb7fc-8fd8-4a7d-80b2-98ca3554a41c", "tag": "fb4083ee-220d-4421-93a3-7c627b1f842c"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:02.447193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-da284aa7-6ca8-4025-903a-05e67bc7dc81 req-7f573808-6098-401f-9cf2-e4f499e7f722 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:02.447708 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-da284aa7-6ca8-4025-903a-05e67bc7dc81 req-7f573808-6098-401f-9cf2-e4f499e7f722 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:02.459324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-da284aa7-6ca8-4025-903a-05e67bc7dc81 req-7f573808-6098-401f-9cf2-e4f499e7f722 service nova] Creating event network-changed:fb4083ee-220d-4421-93a3-7c627b1f842c for instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c on hv-cinder-74014 Aug 01 08:07:02.465120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-da284aa7-6ca8-4025-903a-05e67bc7dc81 req-7f573808-6098-401f-9cf2-e4f499e7f722 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035509 Aug 01 08:07:02.466199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 327/645] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:07:02.581978 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:02.583130 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:02.590243 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:02.591082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:02.592098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:02.592703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:02.915481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:02.918331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:02.923003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-97503977-8521-4348-a456-715758b1d021 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1279 microversion: 2.1 time: 0.344973 Aug 01 08:07:02.924117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 319/646] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:02 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1279 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:03.121670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:03.122372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:03.128572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:03.129017 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:03.129774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:03.130209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:03.263825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:03.271488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5bad95a7-482d-43d4-882d-d27429447fae tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.154650 Aug 01 08:07:03.272173 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 328/647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:03 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:03.943313 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:03.944146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:03.953401 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:03.953854 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:03.954706 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:03.955147 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:04.108318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:04.116938 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-27710d37-917d-434a-918a-7306134316b4 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.177541 Aug 01 08:07:04.118101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 320/648] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:03 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:04.292503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:04.293057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:04.299237 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:04.299713 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:04.300468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:04.300893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:04.427279 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:04.435131 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1c433de6-008c-4492-9f37-5ea3357789b1 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.146592 Aug 01 08:07:04.435716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 329/649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:04 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:04.484065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-dc1d129a-2a49-4f3f-abf6-6a86a86e0d62 req-61097c76-1612-47db-9c2c-40e20ca69c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede14461-4e85-4d6e-b992-91841e96a6fe", "tag": "5e3352b1-549a-4492-b0c7-a28d961cc520"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:04.493985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-dc1d129a-2a49-4f3f-abf6-6a86a86e0d62 req-61097c76-1612-47db-9c2c-40e20ca69c81 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:04.494425 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-dc1d129a-2a49-4f3f-abf6-6a86a86e0d62 req-61097c76-1612-47db-9c2c-40e20ca69c81 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:04.506849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-dc1d129a-2a49-4f3f-abf6-6a86a86e0d62 req-61097c76-1612-47db-9c2c-40e20ca69c81 service nova] Creating event network-changed:5e3352b1-549a-4492-b0c7-a28d961cc520 for instance ede14461-4e85-4d6e-b992-91841e96a6fe on hv-cinder-74014 Aug 01 08:07:04.511864 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-dc1d129a-2a49-4f3f-abf6-6a86a86e0d62 req-61097c76-1612-47db-9c2c-40e20ca69c81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031719 Aug 01 08:07:04.512456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 321/650] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:05.138192 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:05.138838 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:05.144826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:05.145269 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:05.146060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:05.146505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:05.280933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:05.288401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cb315d04-8251-40ee-b9b0-9fa72cd8291b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.154003 Aug 01 08:07:05.288964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 330/651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:05 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:05.457592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:05.458316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:05.465733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:05.466173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:05.466929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:05.467358 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:05.597593 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:05.605488 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-83699b3e-a95c-45f7-a2b2-2a8faa946150 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.152134 Aug 01 08:07:05.606055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 322/652] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:05 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:06.315662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:06.316201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:06.318131 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:06.323079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:06.323544 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:06.324308 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:06.324741 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:06.453236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:06.456606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:06.460860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a3cc6f51-05ca-4d49-8917-b0675809d98b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.149102 Aug 01 08:07:06.462074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 331/653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:06 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:06.626360 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:06.626972 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:06.629498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:06.634290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:06.634725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:06.635513 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:06.635973 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:06.846380 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:06.853827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4a8584a8-1c16-4baa-abdb-6362de7c4cc9 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.231342 Aug 01 08:07:06.854405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 323/654] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:06 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:07.490248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:07.490769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:07.498018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:07.498460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:07.499200 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:07.500387 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:07.635963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:07.643514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6810952a-a8fb-4633-982f-f88c1fa2efe5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.157100 Aug 01 08:07:07.644095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 332/655] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:07 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:07.874982 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:07.875638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:07.877494 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=8 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:07.882736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:07.883438 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:07.884238 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:07.884686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:08.028859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:08.036263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bd6fa587-b1bf-4ded-9829-980ea6dc81e3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.165264 Aug 01 08:07:08.036825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 324/656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:07 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:08.665882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:08.666505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:08.672501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:08.672950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:08.673959 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:08.674392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:08.802653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:08.810076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-29616ad7-dc0e-4e1a-af31-937eaf6e67e2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.148904 Aug 01 08:07:08.810637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 333/657] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:08 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:09.057753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:09.058444 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:09.065320 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:09.065777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:09.066545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:09.066987 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:09.201523 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:09.208982 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2c4bc263-6a9d-4b41-97ad-8aaad17e250d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.155548 Aug 01 08:07:09.213283 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 325/658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:09 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:09.263330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-8d9ad19e-5a0d-4cb3-96a2-c99e176322e9 req-17fadab8-14d4-44f5-b97c-621836a995ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108bb7fc-8fd8-4a7d-80b2-98ca3554a41c", "name": "network-vif-plugged", "status": "completed", "tag": "fb4083ee-220d-4421-93a3-7c627b1f842c"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:09.268901 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-8d9ad19e-5a0d-4cb3-96a2-c99e176322e9 req-17fadab8-14d4-44f5-b97c-621836a995ef service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:09.269336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-8d9ad19e-5a0d-4cb3-96a2-c99e176322e9 req-17fadab8-14d4-44f5-b97c-621836a995ef service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:09.281495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-8d9ad19e-5a0d-4cb3-96a2-c99e176322e9 req-17fadab8-14d4-44f5-b97c-621836a995ef service nova] Creating event network-vif-plugged:fb4083ee-220d-4421-93a3-7c627b1f842c for instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c on hv-cinder-74014 Aug 01 08:07:09.286624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-8d9ad19e-5a0d-4cb3-96a2-c99e176322e9 req-17fadab8-14d4-44f5-b97c-621836a995ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031348 Aug 01 08:07:09.288055 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 334/659] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:09.830532 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:09.831258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:09.837283 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:09.837734 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:09.838501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:09.838940 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:09.970378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:09.978331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5e7c7f92-477c-42d5-aa8c-3065e48cf1c9 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.151767 Aug 01 08:07:09.978892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 326/660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:09 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:10.228260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=18 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:10.232380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:10.233077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:10.239057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:10.239498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:10.240282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:10.240712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:10.368316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:10.374131 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7abdd840-f44a-4c5b-b7e7-919e9a868148 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.147594 Aug 01 08:07:10.374689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 335/661] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:10 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:10.998892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:10.999495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:11.006001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:11.006451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:11.007213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:11.007681 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:11.138676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:11.146212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f719a33c-fff3-40e8-a4a5-23ac211fed85 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.151209 Aug 01 08:07:11.146781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 327/662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:10 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:11.394100 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:11.394707 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:11.400672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:11.401119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:11.401866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:11.402297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:11.532692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:11.540813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f2d987c6-07cd-4e56-b6ce-135332867888 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1367 microversion: 2.1 time: 0.150482 Aug 01 08:07:11.541368 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 336/663] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:11 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:12.166483 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:12.167103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:12.174010 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:12.174468 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:12.175244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:12.175727 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:12.312456 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:12.319822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d5fb78d2-cf20-4b56-93d5-994a23b827ae tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.157445 Aug 01 08:07:12.320388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 328/664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:12 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:12.561816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:12.562427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:12.568645 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:12.569084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:12.569854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:12.570283 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:12.699050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:12.706362 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-984ebf3a-c79b-4065-9e48-d52b8c988134 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1557 microversion: 2.1 time: 0.148454 Aug 01 08:07:12.706914 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 337/665] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:12 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:12.728266 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:12.728761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:12.734728 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:12.735178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:12.735996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:12.736437 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:12.814055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e575d7bd-62f1-4511-9f25-31309ee49a15 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090268 Aug 01 08:07:12.814655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 329/666] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:07:12 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:13.285441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:13.285928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:13.292634 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.293120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.293916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.294354 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.341235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:13.341884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:13.348352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.349157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.349963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.350457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.374672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'services' on Instance uuid d69c65b7-c268-424b-bda1-e93e9b42732e {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:07:13.562092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5848b041-8b02-4382-b1e2-7859e47ee18f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments/bdba1521-140c-415c-b6ce-a2cfee9618c9" status: 202 len: 0 microversion: 2.1 time: 0.280264 Aug 01 08:07:13.562729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 338/667] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:07:13 2022] DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments/bdba1521-140c-415c-b6ce-a2cfee9618c9 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:07:13.575362 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:13.579485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:13.584128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.584630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.585493 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.585935 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.595073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:13.607446 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-57989f2b-6373-46cf-b2de-21625cc5ec8a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.267017 Aug 01 08:07:13.607446 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 330/668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:13 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:07:13.616833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c2312385-3063-4d60-ba77-8d972878ccea tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048473 Aug 01 08:07:13.617550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 339/669] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:07:13 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:13.911299 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-4ca60b0d-6396-4de8-b633-eee76fbe1eb2 req-ab8f73ec-e0f2-4bf6-9970-6e56a25cab30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "108bb7fc-8fd8-4a7d-80b2-98ca3554a41c", "tag": "fb4083ee-220d-4421-93a3-7c627b1f842c"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:13.920955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-4ca60b0d-6396-4de8-b633-eee76fbe1eb2 req-ab8f73ec-e0f2-4bf6-9970-6e56a25cab30 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:13.921397 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-4ca60b0d-6396-4de8-b633-eee76fbe1eb2 req-ab8f73ec-e0f2-4bf6-9970-6e56a25cab30 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:13.933353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-4ca60b0d-6396-4de8-b633-eee76fbe1eb2 req-ab8f73ec-e0f2-4bf6-9970-6e56a25cab30 service nova] Creating event network-changed:fb4083ee-220d-4421-93a3-7c627b1f842c for instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c on hv-cinder-74014 Aug 01 08:07:13.938308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-4ca60b0d-6396-4de8-b633-eee76fbe1eb2 req-ab8f73ec-e0f2-4bf6-9970-6e56a25cab30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030623 Aug 01 08:07:13.938883 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 331/670] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:14.624042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:14.624690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:14.630519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:14.630976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:14.631325 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:14.632112 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:14.632548 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:14.637028 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:14.645198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:14.645890 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:14.647049 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:14.647688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:14.680297 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-116a02fd-12ca-486d-b005-a6e27b11b93c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054464 Aug 01 08:07:14.681143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 332/671] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:07:14 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:07:14.776778 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:14.784683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e29b042b-800c-409a-8218-defbf61dd18f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.164417 Aug 01 08:07:14.785179 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 340/672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:14 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:15.692851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:15.694937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:15.702128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:15.702583 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:15.703350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:15.703811 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:15.732302 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3dfaa704-43e0-4701-a3b0-9f72976b21e0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043463 Aug 01 08:07:15.732857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 333/673] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:07:15 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:07:15.806816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:15.807415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:15.813482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:15.813929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:15.814687 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:15.815123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:15.947151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:15.954673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4f93763d-6a02-4252-958a-5cb6b6a91a9d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.152271 Aug 01 08:07:15.955233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 341/674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:15 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:16.744648 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:16.746856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:16.753471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:16.753928 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:16.754709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:16.755156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:16.785237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-32bd8984-df58-4f77-ba9f-761574202b2a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044600 Aug 01 08:07:16.785832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 334/675] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:07:16 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:07:16.863916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:16.864444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:16.871180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:16.871664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:16.872425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:16.872862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:16.897442 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:07:16.975250 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:16.975935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:16.982267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:16.982719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:16.983486 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:16.983954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:17.121568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:17.129980 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ec2cd540-f19c-4616-ae39-c3b3ef39bd3c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.158496 Aug 01 08:07:17.130728 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 335/676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:16 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:07:17.203007 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-34802ca0-63f1-48d5-be3e-2f4fdf1a946c tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 204 len: 0 microversion: 2.1 time: 0.342851 Aug 01 08:07:17.203765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 342/677] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:07:16 2022] DELETE /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:07:17.212090 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:17.218537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:17.218871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:17.219048 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:17.219843 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:17.220281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:17.355910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:17.363720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-12e48e54-39e8-4595-9617-96c72cd90e5e tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1688 microversion: 2.1 time: 0.155688 Aug 01 08:07:17.364565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 336/678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:17 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:18.153139 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:18.153835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:18.159871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:18.160323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:18.161109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:18.161568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:18.294251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:18.302046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1f30c21e-c36b-4afc-98a1-0a65ae1b4597 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.153942 Aug 01 08:07:18.302601 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 343/679] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:18 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:18.385677 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:18.386293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:18.392909 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:18.393373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:18.394143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:18.394584 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:18.522173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:18.529655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a89a5dc9-4d14-4a05-aae1-cea0502b582d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1688 microversion: 2.1 time: 0.148766 Aug 01 08:07:18.530224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 337/680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:18 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:19.323887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:19.324476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:19.330155 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:19.330593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:19.331349 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:19.331801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:19.398141 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-7cffb13c-7fd3-42af-8c5c-9a7bad34f113 req-a8e3d23a-89eb-433c-b5fa-aa5e0ab809f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede14461-4e85-4d6e-b992-91841e96a6fe", "name": "network-vif-plugged", "status": "completed", "tag": "5e3352b1-549a-4492-b0c7-a28d961cc520"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:19.409611 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-7cffb13c-7fd3-42af-8c5c-9a7bad34f113 req-a8e3d23a-89eb-433c-b5fa-aa5e0ab809f5 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:19.410070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-7cffb13c-7fd3-42af-8c5c-9a7bad34f113 req-a8e3d23a-89eb-433c-b5fa-aa5e0ab809f5 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:19.414065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:19.422000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-7cffb13c-7fd3-42af-8c5c-9a7bad34f113 req-a8e3d23a-89eb-433c-b5fa-aa5e0ab809f5 service nova] Creating event network-vif-plugged:5e3352b1-549a-4492-b0c7-a28d961cc520 for instance ede14461-4e85-4d6e-b992-91841e96a6fe on hv-cinder-74014 Aug 01 08:07:19.427616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-7cffb13c-7fd3-42af-8c5c-9a7bad34f113 req-a8e3d23a-89eb-433c-b5fa-aa5e0ab809f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033118 Aug 01 08:07:19.428214 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 338/681] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:07:19.466057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:19.473533 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6d4fc738-a175-416d-ba55-f96e8510e6aa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.153856 Aug 01 08:07:19.479125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 344/682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:19 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:19.550900 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:19.551636 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:19.558553 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:19.559010 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:19.560076 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:19.560527 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:19.691244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:19.699409 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4b1a7603-0baf-44cc-ad9d-9aa76309e5d3 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1688 microversion: 2.1 time: 0.152948 Aug 01 08:07:19.700000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 339/683] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:19 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:20.494762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:20.496142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:20.502792 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:20.503241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:20.504038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:20.504471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:20.641326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:20.649004 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-73da093b-ca98-48c9-b13c-4d21ee6ca01d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.158759 Aug 01 08:07:20.650183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 345/684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:20 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:20.720620 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:20.721395 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:20.728968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:20.729530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:20.730405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:20.730918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:20.874603 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:20.882168 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-363e66bb-5b3f-4afa-a57f-9b90143f4e7b tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1688 microversion: 2.1 time: 0.165374 Aug 01 08:07:20.882740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 340/685] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:20 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:21.671137 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:21.671810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:21.678257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:21.678703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:21.679469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:21.679930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:21.820854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:21.824492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:21.829095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fdbfa051-aa56-4eca-8a27-1776b7e6ad5b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1267 microversion: 2.1 time: 0.161918 Aug 01 08:07:21.829664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 346/686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:21 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:21.904002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:21.904761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:21.911260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:21.911745 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:21.912514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:21.912951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:22.215448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:22.224784 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8ae50fb2-3130-441e-b55d-6a5d8454d27f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1688 microversion: 2.1 time: 0.324789 Aug 01 08:07:22.225592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 341/687] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:21 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1688 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:22.683324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-15b1ab7b-2e58-445f-9a9b-bb863eb6ee4b req-453b87a5-510a-402e-9ef0-4a010f2e40ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d69c65b7-c268-424b-bda1-e93e9b42732e", "name": "network-vif-deleted", "tag": "575f0fe0-ae51-4fa5-8a22-b9afe5af92d1"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:22.694565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-15b1ab7b-2e58-445f-9a9b-bb863eb6ee4b req-453b87a5-510a-402e-9ef0-4a010f2e40ac service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:22.727404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-15b1ab7b-2e58-445f-9a9b-bb863eb6ee4b req-453b87a5-510a-402e-9ef0-4a010f2e40ac service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:22.727404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-15b1ab7b-2e58-445f-9a9b-bb863eb6ee4b req-453b87a5-510a-402e-9ef0-4a010f2e40ac service nova] Creating event network-vif-deleted:575f0fe0-ae51-4fa5-8a22-b9afe5af92d1 for instance d69c65b7-c268-424b-bda1-e93e9b42732e on hv-cinder-74014 Aug 01 08:07:22.727404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-15b1ab7b-2e58-445f-9a9b-bb863eb6ee4b req-453b87a5-510a-402e-9ef0-4a010f2e40ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Aug 01 08:07:22.727404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 347/688] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:22.853178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:22.855059 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:22.862808 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:22.863658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:22.864954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:22.865515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:23.020346 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:23.028956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-88e18d95-2a09-4a51-9391-7dafaa90944a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1454 microversion: 2.1 time: 0.182180 Aug 01 08:07:23.029637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 342/689] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:22 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:23.052615 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:23.053308 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:23.060905 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:23.061377 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:23.062124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:23.062559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:23.205294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:23.213743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b4a2ef2f-02de-452c-877c-a189490f2755 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1454 microversion: 2.1 time: 0.165498 Aug 01 08:07:23.214323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 348/690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:23 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:23.246579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:23.247713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:23.253609 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:23.254178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:23.255052 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:23.255618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:23.288738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:23.289204 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:23.289659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'fault' on Instance uuid d69c65b7-c268-424b-bda1-e93e9b42732e {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:07:23.336743 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:23.345692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f6824176-594f-46e6-ae1d-02b0b9d173b0 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 200 len: 1335 microversion: 2.1 time: 0.103310 Aug 01 08:07:23.351710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 343/691] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:23 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 1335 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:24.367182 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:24.367808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: d69c65b7-c268-424b-bda1-e93e9b42732e] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:24.374375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:24.374819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:24.375592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:24.376018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:24.389884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] HTTP exception thrown: Instance d69c65b7-c268-424b-bda1-e93e9b42732e could not be found. Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Request method failure captured: Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e HTTP/1.1 Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gWx0OjsQ2RLiwgJ0Jh8IQ4C1sjlFSb0jZ8QmC1E2aXvnhiXEgz_ZibRsx_B01SZHESwZ6mLLOB7ybMc4FhP2IW2X0T3cEmOv7baMLkdG0U3us5loVNJvJLPgoB_c3PlM9nu_z8P99XvhqtRAfV8OtMB0JqungL7H2ls_p6_TXd7rk Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:07:24.391508 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aae673506a1a4ea2b3209c8a86b3a33b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 972bc4e9bc9e49b4a3bc2a693b05e4ab Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance d69c65b7-c268-424b-bda1-e93e9b42732e could not be found. Aug 01 08:07:24.393205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': 'd69c65b7-c268-424b-bda1-e93e9b42732e'} Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d69c65b7-c268-424b-bda1-e93e9b42732e could not be found. Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:07:24.394123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d69c65b7-c268-424b-bda1-e93e9b42732e could not be found. Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d69c65b7-c268-424b-bda1-e93e9b42732e could not be found. Aug 01 08:07:24.395679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:24.397003 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Returning 404 to user: Instance d69c65b7-c268-424b-bda1-e93e9b42732e could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:07:24.397003 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f2c66bf5-c9e1-4a71-acb0-9bec79b19149 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e" status: 404 len: 111 microversion: 2.1 time: 0.029732 Aug 01 08:07:24.397003 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 349/692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:24 2022] GET /compute/v2.1/servers/d69c65b7-c268-424b-bda1-e93e9b42732e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:07:24.402101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4e478945-539a-4485-901f-ddaafc5f9b37 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '.version_select at 0x7efe3f35d280>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:24.484325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4e478945-539a-4485-901f-ddaafc5f9b37 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488425694" status: 202 len: 0 microversion: 2.1 time: 0.086425 Aug 01 08:07:24.484919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 344/693] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 08:07:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488425694 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:07:25.303728 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-8528dcb8-c092-4834-9c77-f10aaf8d6ffd req-71b0bf36-e618-46e1-afdc-d6615750bf67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede14461-4e85-4d6e-b992-91841e96a6fe", "tag": "5e3352b1-549a-4492-b0c7-a28d961cc520"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:25.314881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-8528dcb8-c092-4834-9c77-f10aaf8d6ffd req-71b0bf36-e618-46e1-afdc-d6615750bf67 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:25.315548 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-8528dcb8-c092-4834-9c77-f10aaf8d6ffd req-71b0bf36-e618-46e1-afdc-d6615750bf67 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:25.329249 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-8528dcb8-c092-4834-9c77-f10aaf8d6ffd req-71b0bf36-e618-46e1-afdc-d6615750bf67 service nova] Creating event network-changed:5e3352b1-549a-4492-b0c7-a28d961cc520 for instance ede14461-4e85-4d6e-b992-91841e96a6fe on hv-cinder-74014 Aug 01 08:07:25.334893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-8528dcb8-c092-4834-9c77-f10aaf8d6ffd req-71b0bf36-e618-46e1-afdc-d6615750bf67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034953 Aug 01 08:07:25.335682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 350/694] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:27.914607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:27.915747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:27.921747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:27.923847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:27.923847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:27.923847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:27.951605 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:07:28.233882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b2e9e3e3-1bea-42b7-9007-e26e1d1e928d tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 204 len: 0 microversion: 2.1 time: 0.323483 Aug 01 08:07:28.234478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 345/695] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:07:27 2022] DELETE /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:07:28.243317 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:28.244049 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:28.245950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:28.250743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:28.251185 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:28.251964 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:28.252393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:28.386177 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:28.393464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e500ed1e-a201-404f-b010-023948b82266 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1507 microversion: 2.1 time: 0.154626 Aug 01 08:07:28.394013 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 351/696] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:28 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:29.415873 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:29.416424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:29.418828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:07:29.423804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:29.426562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:29.426562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:29.426562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:29.619263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:29.626721 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-aafd2666-0f70-415b-aabc-d844e881a8d8 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1507 microversion: 2.1 time: 0.215990 Aug 01 08:07:29.627290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 346/697] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:29 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:29.793877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-98f56e40-f1cc-4f7d-be9d-4e793d66354a req-8ab94de8-062f-4662-9dcc-752dea295edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb98b62-cfe8-45eb-95c6-c705fccab622", "name": "network-vif-deleted", "tag": "2d0b2d0a-db6a-41b3-b644-b06af8787bc8"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:29.803392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-98f56e40-f1cc-4f7d-be9d-4e793d66354a req-8ab94de8-062f-4662-9dcc-752dea295edb service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:29.803868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-98f56e40-f1cc-4f7d-be9d-4e793d66354a req-8ab94de8-062f-4662-9dcc-752dea295edb service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:29.814659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-98f56e40-f1cc-4f7d-be9d-4e793d66354a req-8ab94de8-062f-4662-9dcc-752dea295edb service nova] Creating event network-vif-deleted:2d0b2d0a-db6a-41b3-b644-b06af8787bc8 for instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 on hv-cinder-74014 Aug 01 08:07:29.819461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-98f56e40-f1cc-4f7d-be9d-4e793d66354a req-8ab94de8-062f-4662-9dcc-752dea295edb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029787 Aug 01 08:07:29.820382 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 352/698] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:30.648183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:30.648918 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:30.655662 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:30.658975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:30.658975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:30.658975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:30.690013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:30.690467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:30.690915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'fault' on Instance uuid 6fb98b62-cfe8-45eb-95c6-c705fccab622 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:07:30.734641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:30.742023 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e8343b8d-a756-4e96-9cb6-49003049a3a4 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 200 len: 1312 microversion: 2.1 time: 0.097720 Aug 01 08:07:30.742584 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 347/699] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:30 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:07:31.765170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:31.765864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 6fb98b62-cfe8-45eb-95c6-c705fccab622] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:31.772218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:31.772659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:31.773413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:31.773842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:31.787343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] HTTP exception thrown: Instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 could not be found. Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Request method failure captured: Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 HTTP/1.1 Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gWx0OjsQ2RLiwgJ0Jh8IQ4C1sjlFSb0jZ8QmC1E2aXvnhiXEgz_ZibRsx_B01SZHESwZ6mLLOB7ybMc4FhP2IW2X0T3cEmOv7baMLkdG0U3us5loVNJvJLPgoB_c3PlM9nu_z8P99XvhqtRAfV8OtMB0JqungL7H2ls_p6_TXd7rk Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:07:31.788950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aae673506a1a4ea2b3209c8a86b3a33b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 972bc4e9bc9e49b4a3bc2a693b05e4ab Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 could not be found. Aug 01 08:07:31.790542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '6fb98b62-cfe8-45eb-95c6-c705fccab622'} Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 could not be found. Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:07:31.791561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 could not be found. Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 could not be found. Aug 01 08:07:31.793160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:07:31.794710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Returning 404 to user: Instance 6fb98b62-cfe8-45eb-95c6-c705fccab622 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:07:31.794710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b6827170-5b18-42e4-93f2-14be04a12910 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622" status: 404 len: 111 microversion: 2.1 time: 0.029555 Aug 01 08:07:31.794710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 353/700] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:31 2022] GET /compute/v2.1/servers/6fb98b62-cfe8-45eb-95c6-c705fccab622 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:07:31.799601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:31.800108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:31.806570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:31.807694 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:31.808470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:31.808911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:31.833798 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:07:32.153585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-27e87ae2-cd19-4ef3-8bd3-a934f025995f tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "DELETE /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 204 len: 0 microversion: 2.1 time: 0.357863 Aug 01 08:07:32.154201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 348/701] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:07:31 2022] DELETE /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 08:07:32.162159 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:32.162777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:32.169419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:32.169864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:32.170624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:32.171062 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:32.303190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:32.311455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8c54561a-28e7-446c-8368-35dbd358150a tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.153127 Aug 01 08:07:32.312021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 354/702] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:32 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:33.333138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:33.333845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:33.340420 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:33.340870 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:33.341635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:33.342071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:33.469706 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:33.477222 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-82881e1f-b13e-4e63-a717-37da48cd9145 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.148345 Aug 01 08:07:33.531383 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 349/703] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:33 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:34.498389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:34.499119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:34.505050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:34.505501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:34.506265 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:34.506700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:34.640672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:34.646746 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e767f56b-4531-439d-9ce7-7ac31b9c35b2 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1522 microversion: 2.1 time: 0.152400 Aug 01 08:07:34.647233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 355/704] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:34 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:34.881560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-26cb4e97-c6e2-4332-ab7e-374ff4795912 req-1a50648d-e0e1-4401-a344-fb086359b77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90208b0f-9714-4c0b-8a4d-65014a5fbe42", "name": "network-vif-deleted", "tag": "2a5cb53b-f343-4566-ae09-a9b80633224a"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:07:34.896515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-26cb4e97-c6e2-4332-ab7e-374ff4795912 req-1a50648d-e0e1-4401-a344-fb086359b77a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:34.896515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-26cb4e97-c6e2-4332-ab7e-374ff4795912 req-1a50648d-e0e1-4401-a344-fb086359b77a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:34.905408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-26cb4e97-c6e2-4332-ab7e-374ff4795912 req-1a50648d-e0e1-4401-a344-fb086359b77a service nova] Creating event network-vif-deleted:2a5cb53b-f343-4566-ae09-a9b80633224a for instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 on hv-cinder-74014 Aug 01 08:07:34.910457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-26cb4e97-c6e2-4332-ab7e-374ff4795912 req-1a50648d-e0e1-4401-a344-fb086359b77a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032715 Aug 01 08:07:34.911296 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 350/705] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:07:35.667911 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:35.668524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:35.674721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:35.675169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:35.675948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:35.676388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:35.708021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:35.708473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:35.708921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lazy-loading 'fault' on Instance uuid 90208b0f-9714-4c0b-8a4d-65014a5fbe42 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:07:35.751675 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '972bc4e9bc9e49b4a3bc2a693b05e4ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae673506a1a4ea2b3209c8a86b3a33b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:07:35.759711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-296b2eeb-f518-4c96-9961-6d85bad9e8cf tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 200 len: 1312 microversion: 2.1 time: 0.095507 Aug 01 08:07:35.767704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 356/706] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:35 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:07:36.783799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:07:36.784535 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] [instance: 90208b0f-9714-4c0b-8a4d-65014a5fbe42] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:07:36.790692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:36.791232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:36.792037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:07:36.792481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:07:36.808294 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] HTTP exception thrown: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 could not be found. Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Request method failure captured: Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 HTTP/1.1 Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gWx0OjsQ2RLiwgJ0Jh8IQ4C1sjlFSb0jZ8QmC1E2aXvnhiXEgz_ZibRsx_B01SZHESwZ6mLLOB7ybMc4FhP2IW2X0T3cEmOv7baMLkdG0U3us5loVNJvJLPgoB_c3PlM9nu_z8P99XvhqtRAfV8OtMB0JqungL7H2ls_p6_TXd7rk Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:07:36.809882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_aae673506a1a4ea2b3209c8a86b3a33b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/aae673506a1a4ea2b3209c8a86b3a33b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: aae673506a1a4ea2b3209c8a86b3a33b Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-719668728 Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 972bc4e9bc9e49b4a3bc2a693b05e4ab Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-ServerRescueNegativeTestJSON-719668728-project Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 could not be found. Aug 01 08:07:36.811434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '90208b0f-9714-4c0b-8a4d-65014a5fbe42'} Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 could not be found. Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:07:36.812429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 could not be found. Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 could not be found. Aug 01 08:07:36.814064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:07:36.815580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] Returning 404 to user: Instance 90208b0f-9714-4c0b-8a4d-65014a5fbe42 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:07:36.815580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d4dec68a-1116-4d3e-99ff-3bf34d6ebd27 tempest-ServerRescueNegativeTestJSON-719668728 tempest-ServerRescueNegativeTestJSON-719668728-project] 10.222.0.48 "GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42" status: 404 len: 111 microversion: 2.1 time: 0.032396 Aug 01 08:07:36.815580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 351/707] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:07:36 2022] GET /compute/v2.1/servers/90208b0f-9714-4c0b-8a4d-65014a5fbe42 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:08:04.412164 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=13 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:04.412933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=42 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:04.642498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:04.643083 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:04.649505 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:04.650148 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:04.650993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:04.651471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:04.681662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8de9feeb-ff98-4093-bb7c-c53a027f10b6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments/f3e5e6ea-a718-435a-8cf3-4f40bf18d035" status: 200 len: 194 microversion: 2.20 time: 0.274305 Aug 01 08:08:04.682145 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 357/708] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Aug 1 08:08:04 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments/f3e5e6ea-a718-435a-8cf3-4f40bf18d035 => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:08:04.751652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:04.752870 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:04.755504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:04.756292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:04.761779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:04.762889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:04.763573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:04.763902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:04.849761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lazy-loading 'services' on Instance uuid 113f63fa-4474-43ba-bbaa-75beddceb74d {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:08:05.135812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-58fa2804-6605-46ca-a342-22a7f198bf99 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments/f3e5e6ea-a718-435a-8cf3-4f40bf18d035" status: 202 len: 0 microversion: 2.20 time: 0.388117 Aug 01 08:08:05.136443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 352/709] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 1 08:08:04 2022] DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments/f3e5e6ea-a718-435a-8cf3-4f40bf18d035 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:08:05.145121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:05.147356 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:05.153912 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.154364 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.155192 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.155622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.187136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ca8a2d02-b3b2-43cc-8137-2d91780d274c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046002 Aug 01 08:08:05.187709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 358/710] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 08:08:05 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:08:05.549082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:05.551401 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:05.557567 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.558021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.558832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.559267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.587790 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-74151217-dc6e-4fd1-9722-e8ac8f97f0fd tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043221 Aug 01 08:08:05.588342 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 353/711] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:08:05 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:08:05.659884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:05.660493 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:05.666601 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.667054 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.668554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.668988 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.693586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:08:05.931127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d1d6f133-10f9-49b4-acf2-c280e55505f4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 204 len: 0 microversion: 2.1 time: 0.275095 Aug 01 08:08:05.931746 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 359/712] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:08:05 2022] DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:08:05.940146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:05.940780 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:05.947183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.947656 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:05.948410 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:05.948838 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:06.095485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:06.102981 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7b1a2b2a-bb63-40b4-8420-c55edbe287fe tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1670 microversion: 2.1 time: 0.166661 Aug 01 08:08:06.103582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 354/713] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:05 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:06.200516 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:06.202895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:06.208847 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:06.209320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:06.210059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:06.210495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:06.243231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6da48597-cc8b-46b5-ad21-598361950edd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047200 Aug 01 08:08:06.243904 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 360/714] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 08:08:06 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:08:07.124544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:07.125121 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:07.131620 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.132082 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.132852 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.133295 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.255311 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:07.257476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:07.264467 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.264846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.282709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.282709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.293354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:07.294021 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-672a5faa-9e26-40b4-881a-e3268e8d9489 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042629 Aug 01 08:08:07.294583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 361/715] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 08:08:07 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:08:07.302171 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dc22240d-9cbd-4c3d-b9f2-863dc476e8cf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1670 microversion: 2.1 time: 0.181922 Aug 01 08:08:07.302606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 355/716] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:07 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:07.356703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:07.357202 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:07.363077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.363540 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.364305 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.364732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.390986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:08:07.679454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8df6c215-f6b4-4b8e-838f-378e5fdb239d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 204 len: 0 microversion: 2.20 time: 0.326844 Aug 01 08:08:07.680292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 362/717] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 08:08:07 2022] DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 08:08:07.694419 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:07.695114 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:07.701781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.702306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.703145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:07.703668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:07.940036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:07.948869 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:07.950958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:07.952172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-82a87d34-faba-4da5-b700-5ff440e87e2c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.261646 Aug 01 08:08:07.952735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 356/718] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:07 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:08:08.324087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:08.324916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:08.331183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:08.335295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:08.335295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:08.335295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:08.397990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:08.405738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8d845759-7921-4308-9f6d-928015b7b6e8 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1603 microversion: 2.1 time: 0.086379 Aug 01 08:08:08.406254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 363/719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:08 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1603 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:08.471805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-9e550b16-fa4f-41d2-9f23-f5772a24a1dc req-601f2af0-4833-4d3e-9119-85a0fda8381c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f414074-c855-47d5-b2f8-ed5bb4b20b50", "name": "network-vif-deleted", "tag": "9fa8b862-e443-4998-b915-92bdaff39190"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:08.484763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-9e550b16-fa4f-41d2-9f23-f5772a24a1dc req-601f2af0-4833-4d3e-9119-85a0fda8381c service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:08.485211 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-9e550b16-fa4f-41d2-9f23-f5772a24a1dc req-601f2af0-4833-4d3e-9119-85a0fda8381c service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:08.498160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-9e550b16-fa4f-41d2-9f23-f5772a24a1dc req-601f2af0-4833-4d3e-9119-85a0fda8381c service nova] Creating event network-vif-deleted:9fa8b862-e443-4998-b915-92bdaff39190 for instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 on hv-cinder-74014 Aug 01 08:08:08.507750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-9e550b16-fa4f-41d2-9f23-f5772a24a1dc req-601f2af0-4833-4d3e-9119-85a0fda8381c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039717 Aug 01 08:08:08.508668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 357/720] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:08.974615 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:08.975292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:08.982906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:08.983354 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:08.984368 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:08.984800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:09.171916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:09.181027 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:09.182816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:09.184055 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0fbc5078-fab5-41d4-9823-bdddb736a902 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.213493 Aug 01 08:08:09.184873 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 364/721] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:08 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:09.428034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:09.428743 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:09.435888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:09.436343 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:09.437118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:09.437751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:09.470905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:09.471370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:09.471928 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lazy-loading 'fault' on Instance uuid 6f414074-c855-47d5-b2f8-ed5bb4b20b50 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:08:09.534888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:09.542539 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2fdca81e-b6df-46c4-9be9-b6ebe5651a1d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 200 len: 1326 microversion: 2.1 time: 0.119024 Aug 01 08:08:09.550893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 358/722] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:09 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:10.211772 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:10.212500 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:10.220924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:10.221411 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:10.222397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:10.222833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:10.362721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:10.373166 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:10.374733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:10.376641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-15b1532a-48e9-446c-a8f3-df3ca10925c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1723 microversion: 2.20 time: 0.168787 Aug 01 08:08:10.377520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 365/723] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:10 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:08:10.563930 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:10.564545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:10.571054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:10.571524 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:10.572328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:10.572771 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:10.587473 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] HTTP exception thrown: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Request method failure captured: Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 HTTP/1.1 Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gWQig4jZFCarWcvni1m8DYTpVHkpSsMZ7cp_eQyBiA415Ia0Caccei4sqLuFeIBYNqD8qZv_HzTI1eCiqHVqo0stJdNRFBYSNXtCM4lHi7rqp7gTOHGnoTEAXo8rqO6282NzjHAB2mzWIZRS1pgRRwKWwWAlcMq6gXUn8O5cU2tgM Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:08:10.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_606b2e9ca91341fe9bbe157935c5736e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: f030155981d741f1a42b9b84ca5d6af4 Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:08:10.591657 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '6f414074-c855-47d5-b2f8-ed5bb4b20b50'} Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:08:10.592795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:08:10.601196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:08:10.603186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Returning 404 to user: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:08:10.603186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e5ad150f-492a-4a0f-beb7-bb8eb6fe3cc7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 404 len: 111 microversion: 2.1 time: 0.031081 Aug 01 08:08:10.603186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 359/724] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:10 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:08:10.605954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-65e6ab0f-51ac-4acf-8004-9b6245c8bac2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '.version_select at 0x7efe3f47d550>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:10.661812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-190860ef-3911-42d0-8c19-e6b0b1e7b8e1 req-1b897b8a-5796-481a-84b7-259c7ea40e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "113f63fa-4474-43ba-bbaa-75beddceb74d", "name": "network-vif-deleted", "tag": "daa76105-034d-4c5f-86e2-217a532d6cef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:10.677111 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-190860ef-3911-42d0-8c19-e6b0b1e7b8e1 req-1b897b8a-5796-481a-84b7-259c7ea40e75 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:10.677638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-190860ef-3911-42d0-8c19-e6b0b1e7b8e1 req-1b897b8a-5796-481a-84b7-259c7ea40e75 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:10.688959 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-65e6ab0f-51ac-4acf-8004-9b6245c8bac2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-723233961" status: 202 len: 0 microversion: 2.1 time: 0.087133 Aug 01 08:08:10.691233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 366/725] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 08:08:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-723233961 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 08:08:10.693455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-190860ef-3911-42d0-8c19-e6b0b1e7b8e1 req-1b897b8a-5796-481a-84b7-259c7ea40e75 service nova] Creating event network-vif-deleted:daa76105-034d-4c5f-86e2-217a532d6cef for instance 113f63fa-4474-43ba-bbaa-75beddceb74d on hv-cinder-74014 Aug 01 08:08:10.703237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-190860ef-3911-42d0-8c19-e6b0b1e7b8e1 req-1b897b8a-5796-481a-84b7-259c7ea40e75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044147 Aug 01 08:08:10.704204 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 360/726] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:08:11.401550 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:11.402927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:11.410693 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:11.412881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:11.412881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:11.413329 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:11.456925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:11.457369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:11.457895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lazy-loading 'fault' on Instance uuid 113f63fa-4474-43ba-bbaa-75beddceb74d {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:08:11.508028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:11.517183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:11.519622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:11.520892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6acf1a0d-4b0c-4965-9f2e-176d7a245334 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 200 len: 1372 microversion: 2.20 time: 0.124082 Aug 01 08:08:11.521519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 367/727] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:11 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:08:11.853045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-384ce40a-0355-4f15-8eb0-9730034f226d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: .version_select at 0x7efe3f334670>, body: {"keypair": {"name": "tempest-keypair-200413725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLz0J7G4qpAFAADP47kVhuox25yN6CxlEmFje0j0vuuSoUOwvSwdFMbFRS0OI+CLthZlv2Yy4DR8AtTyMrFGguu8ThIoe0uDXwVQkGvg6weGSFF+d5oUXkHYaNxNCZdxdw=="}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:11.882423 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-384ce40a-0355-4f15-8eb0-9730034f226d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:08:11.890658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-384ce40a-0355-4f15-8eb0-9730034f226d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for user f030155981d741f1a42b9b84ca5d6af4 and project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:08:11.977904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-384ce40a-0355-4f15-8eb0-9730034f226d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.129471 Aug 01 08:08:11.978591 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 361/728] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:08:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:12.545864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:12.546527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:12.552769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:12.553215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:12.553980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:12.554417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:12.567658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] HTTP exception thrown: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Request method failure captured: Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d HTTP/1.1 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54iDIdtR2YLs41AuU_BM2BDCEOJ-LPVUWh8hvpahCjM_EtEY4T7KK1oW50h1zLyxtDwOvPn0Mn-kAHZyP5ql7noI0WLgNQdXZ4-_VliMCjDmtq2QatgHLj50FTURfq8N1KX4AyMN0W8LDOt6xWLrCjReogsIuUgkcgfnUmXrs0xGscc Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:08:12.569289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3129476636bb43e9a14ef674c4720233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3129476636bb43e9a14ef674c4720233", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 14e5f1b4073742b4b9bd8a48cce38341 Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:08:12.570874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '113f63fa-4474-43ba-bbaa-75beddceb74d'} Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:08:12.571983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:08:12.573429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:08:12.575644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Returning 404 to user: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:08:12.575644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-41734488-63e5-4e9c-9c12-5a68a268c712 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 404 len: 111 microversion: 2.20 time: 0.029410 Aug 01 08:08:12.575644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 368/729] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:12 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:08:12.580553 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-001933ff-cf63-4cc5-aa51-7f7837e63e53 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '.version_select at 0x7efe3f35d700>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:12.669252 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-001933ff-cf63-4cc5-aa51-7f7837e63e53 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551654738" status: 204 len: 0 microversion: 2.20 time: 0.092531 Aug 01 08:08:12.669773 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 362/730] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Aug 1 08:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551654738 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 08:08:13.484241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0a4604aa-f0c3-49fc-be3a-2b18bf355db2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'create', calling method: .version_select at 0x7efe3f54e040>, body: {"keypair": {"name": "tempest-keypair-392782453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd1SxaRp9+99U0cVtppUXZusclKmI8DWnUSKBNXnXMDuL2j6eDvCUJybAu6AMlmAqYBVfLwO2cSe1e5TphziQihS5SGqw3Ziw8PgDxcqvVQYvbGE838QpzA3wlvs1dVrA=="}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:13.499871 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-0a4604aa-f0c3-49fc-be3a-2b18bf355db2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for project 3129476636bb43e9a14ef674c4720233. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:08:13.503768 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-0a4604aa-f0c3-49fc-be3a-2b18bf355db2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for user 14e5f1b4073742b4b9bd8a48cce38341 and project 3129476636bb43e9a14ef674c4720233. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:08:13.566504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0a4604aa-f0c3-49fc-be3a-2b18bf355db2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.086342 Aug 01 08:08:13.567448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 369/731] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 1 08:08:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 01 08:08:14.488576 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-361910839", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43709bde-c530-4a06-9050-7c287d9a00eb"}], "security_groups": [{"name": "tempest-securitygroup--733779296"}], "key_name": "tempest-keypair-200413725", "user_data": "}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:14.605292 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] validate_networks() for [('43709bde-c530-4a06-9050-7c287d9a00eb', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:08:14.990991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:08:14.991431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:08:14.991942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:08:14.992359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:08:14.992777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:08:15.002992 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:15.004206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:15.004441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:15.004894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:15.022696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:08:15.027019 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Getting quotas for user f030155981d741f1a42b9b84ca5d6af4 and project 606b2e9ca91341fe9bbe157935c5736e. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:08:15.038830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:08:15.041269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:08:15.191250 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9340d24c-93b0-45a3-8026-8d20d339fe76 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.707409 Aug 01 08:08:15.191988 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 363/732] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:08:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:08:15.203202 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-574dedd1-8e7d-4f66-8b53-ef46807e5e0a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:15.204108 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-574dedd1-8e7d-4f66-8b53-ef46807e5e0a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:15.298235 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-574dedd1-8e7d-4f66-8b53-ef46807e5e0a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:15.308132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-574dedd1-8e7d-4f66-8b53-ef46807e5e0a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1236 microversion: 2.1 time: 0.108954 Aug 01 08:08:15.309313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 370/733] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:15 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1236 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:16.198712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795087374", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5256f87-c2ff-467e-8ab7-6b930400a6a4"}], "security_groups": [{"name": "tempest-securitygroup--1263316420"}], "key_name": "tempest-keypair-392782453", "user_data": "}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:16.302138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] validate_networks() for [('a5256f87-c2ff-467e-8ab7-6b930400a6a4', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:08:16.330335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:16.330950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:16.337116 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:16.337636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:16.338472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:16.338985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:16.409892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:16.436172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-448c5829-8c0c-40fc-af87-2d0094114660 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1240 microversion: 2.1 time: 0.109680 Aug 01 08:08:16.447997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 371/734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:16 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1240 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:16.705849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:08:16.706348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:08:16.706889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:08:16.707361 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:08:16.707881 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:08:16.717671 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:16.718200 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:16.719060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:16.719579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:16.736766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for project 3129476636bb43e9a14ef674c4720233. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:08:16.740590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Getting quotas for user 14e5f1b4073742b4b9bd8a48cce38341 and project 3129476636bb43e9a14ef674c4720233. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:08:16.752071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:08:16.754276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:08:16.900371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2ab0109a-5030-4085-b624-4edc37d698b2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.707733 Aug 01 08:08:16.901592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 364/735] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 1 08:08:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 08:08:16.912716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bb2eb49c-f4fb-4e5e-98c6-c78a9f416868 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:16.913417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bb2eb49c-f4fb-4e5e-98c6-c78a9f416868 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:16.977086 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bb2eb49c-f4fb-4e5e-98c6-c78a9f416868 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:16.985676 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bb2eb49c-f4fb-4e5e-98c6-c78a9f416868 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:16.987375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bb2eb49c-f4fb-4e5e-98c6-c78a9f416868 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:16.988878 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bb2eb49c-f4fb-4e5e-98c6-c78a9f416868 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1281 microversion: 2.20 time: 0.080094 Aug 01 08:08:16.989394 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 372/736] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:16 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:08:17.458637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:17.459976 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:17.467766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:17.468217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:17.468986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:17.469422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:17.543160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:17.551425 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0c817570-c25d-413c-838c-f51008cc8027 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1306 microversion: 2.1 time: 0.097113 Aug 01 08:08:17.552025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 365/737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:17 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:18.017946 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:18.018586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:18.033640 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:18.034481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:18.035880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:18.036562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:18.135344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:18.150329 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:18.152657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:18.153816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-28b74f59-cd38-4344-b746-303fde07abf0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1285 microversion: 2.20 time: 0.144342 Aug 01 08:08:18.154373 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 373/738] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:18 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:18.575191 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:18.575850 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:18.582339 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:18.582785 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:18.583550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:18.583994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:18.819623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:18.828383 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-adab3195-7b0c-4b43-8be6-e4d37909f708 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.259218 Aug 01 08:08:18.842159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 366/739] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:18 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:19.085289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-1e0c02a4-0e1e-4835-a119-1d7fbd66f9bc req-e716e9ec-8000-4ddd-a8d4-48b921049cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b2cb14-6d38-40cf-a791-d315daf65b9c", "tag": "f112f7ae-534b-463d-a1ae-edb3cbb1c9f8"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:19.095303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-1e0c02a4-0e1e-4835-a119-1d7fbd66f9bc req-e716e9ec-8000-4ddd-a8d4-48b921049cce service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:19.095777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-1e0c02a4-0e1e-4835-a119-1d7fbd66f9bc req-e716e9ec-8000-4ddd-a8d4-48b921049cce service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:19.107294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-1e0c02a4-0e1e-4835-a119-1d7fbd66f9bc req-e716e9ec-8000-4ddd-a8d4-48b921049cce service nova] Creating event network-changed:f112f7ae-534b-463d-a1ae-edb3cbb1c9f8 for instance 17b2cb14-6d38-40cf-a791-d315daf65b9c on hv-cinder-74014 Aug 01 08:08:19.112385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-1e0c02a4-0e1e-4835-a119-1d7fbd66f9bc req-e716e9ec-8000-4ddd-a8d4-48b921049cce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030702 Aug 01 08:08:19.113242 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 374/740] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:08:19.177443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:19.178118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:19.184647 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:19.185291 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:19.186077 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:19.186648 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:19.292469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:19.305587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:19.307071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:19.308267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-51a6390a-e388-4328-9501-e865b897bf88 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1351 microversion: 2.20 time: 0.135058 Aug 01 08:08:19.308903 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 367/741] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:19 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1351 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:19.850181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:19.850926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:19.857580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:19.858032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:19.858875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:19.859315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:19.864025 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:20.015066 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:20.022828 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-270d9a36-33e8-467e-8a5a-0a94d79f141e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.176904 Aug 01 08:08:20.023401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 375/742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:19 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:20.331393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:20.333020 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:20.343662 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:20.344586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:20.345841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:20.346676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:20.553260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:20.563427 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:20.564984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:20.566108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c3b09c53-e272-4057-83a9-37fbef992c7c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.239086 Aug 01 08:08:20.571354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 368/743] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:20 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:21.045214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:21.045800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:21.054335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:21.054785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:21.056876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:21.057328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:21.203983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:21.211796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1a1c2abb-35dc-42b3-b6de-10dccb6f5337 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.171261 Aug 01 08:08:21.212364 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 376/744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:21 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:21.447184 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-1957d10d-afe0-4376-bdc7-b5c7cde0de89 req-58566b74-ffdf-483b-8d29-4a25d086641c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:21.458013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-1957d10d-afe0-4376-bdc7-b5c7cde0de89 req-58566b74-ffdf-483b-8d29-4a25d086641c service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:21.458467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-1957d10d-afe0-4376-bdc7-b5c7cde0de89 req-58566b74-ffdf-483b-8d29-4a25d086641c service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:21.469979 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-1957d10d-afe0-4376-bdc7-b5c7cde0de89 req-58566b74-ffdf-483b-8d29-4a25d086641c service nova] Creating event network-changed:e9254c41-aa3b-44bb-acda-eff5bfc51cda for instance 0301e609-db16-49d6-8655-2f8033dbadaf on hv-cinder-74014 Aug 01 08:08:21.474816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-1957d10d-afe0-4376-bdc7-b5c7cde0de89 req-58566b74-ffdf-483b-8d29-4a25d086641c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031439 Aug 01 08:08:21.475408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 369/745] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:21.591462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:21.592092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:21.598528 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:21.598974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:21.599769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:21.600203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:21.732743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:21.741027 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:21.742553 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:21.743698 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4913e3bb-72ae-4636-9089-6eb9c7c6d3d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.157258 Aug 01 08:08:21.744250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 377/746] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:21 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:22.233867 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:22.234565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:22.241002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:22.241458 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:22.242235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:22.242676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:22.371073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:22.379352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1df81390-30aa-4b5d-a17e-363ee49d14f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.149888 Aug 01 08:08:22.379933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 370/747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:22 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:22.766295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:22.766900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:22.773481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:22.774228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:22.775208 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:22.775767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:22.920856 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:22.929611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:22.931099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:22.932222 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cb51c818-bb72-4dd4-979e-bbe321f5390d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.170039 Aug 01 08:08:22.933174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 378/748] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:22 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:23.401028 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:23.402240 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:23.409515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:23.409965 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:23.410961 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:23.411398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:23.574958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:23.582547 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-af18dadc-a499-456b-8ff1-739b777e291e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.185473 Aug 01 08:08:23.583113 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 371/749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:23 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:23.956104 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:23.956716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:23.962747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:23.963191 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:23.963978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:23.964413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:24.095138 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:24.104838 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:24.106972 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:24.108552 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dab9e04a-71da-4535-972d-8e29894591b4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.156264 Aug 01 08:08:24.109240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 379/750] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:23 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:24.603690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:24.604308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:24.611081 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:24.611556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:24.612307 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:24.612742 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:24.740564 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:24.748346 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2efe4987-e5bf-44e6-ae70-7bf6f77cebc0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.148486 Aug 01 08:08:24.751641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 372/751] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:24 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:25.132869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:25.133478 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:25.140498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:25.141327 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:25.141686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:25.142120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:25.277318 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:25.285837 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:25.287312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:25.288448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-78ed36c1-034d-4364-ab7d-1be71f523e28 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.159466 Aug 01 08:08:25.288994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 380/752] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:25 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:25.768977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:25.769597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:25.776180 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:25.776630 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:25.777391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:25.778118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:25.797985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:25.912006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:25.921039 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7acb52b2-a3ef-4f8b-b885-9ff837b55763 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.155616 Aug 01 08:08:25.921626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 373/753] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:25 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:26.310801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:26.311554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:26.317429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:26.317868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:26.318609 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:26.319034 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:26.444943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:26.453422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:26.454953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:26.456096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-de083c9a-f133-4ddc-b9a5-6969bb28c6a2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.149367 Aug 01 08:08:26.456653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 381/754] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:26 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:26.942841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:26.943460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:26.945287 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=4 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:26.946104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=16 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:26.952025 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:26.952482 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:26.953252 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:26.953695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:27.085484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:27.092884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a46a439c-9df0-4490-a5ea-bfabf50a2771 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.153888 Aug 01 08:08:27.093448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 374/755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:26 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:27.480075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:27.481206 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:27.483016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=8 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:27.487866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:27.489063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:27.489063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:27.489514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:27.616597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:27.624619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:27.626153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:27.627251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4b55de1a-9b44-4592-813c-554ce294c042 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.151090 Aug 01 08:08:27.627847 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 382/756] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:27 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:28.112958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:28.113609 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:28.120325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:28.120774 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:28.125263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:28.125263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:28.252889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:28.260451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bef682f8-39e6-4322-b285-15fd5b42c6aa tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.151473 Aug 01 08:08:28.261016 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 375/757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:28 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:28.650073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:28.650755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:28.657177 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:28.657616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:28.658411 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:28.658848 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:28.793514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:28.801744 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:28.803238 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:28.804372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1290132b-cda7-4e13-b111-a9cb1abce31c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.158175 Aug 01 08:08:28.805107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 383/758] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:28 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:29.281946 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:29.282607 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:29.289035 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:29.289489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:29.290531 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:29.291019 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:29.421561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:29.429018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6aac05b3-eadf-4f06-97fa-50ba3611caa3 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.151326 Aug 01 08:08:29.429573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 376/759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:29 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:29.827125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:29.827760 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:29.833767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:29.834209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:29.834950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:29.835375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:29.961496 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:29.970521 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:29.972032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:29.973132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-55741d20-e87e-4eeb-ba9f-60e8dba05e39 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.149881 Aug 01 08:08:29.973679 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 384/760] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:29 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:30.440576 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-5c361656-b637-4295-bfaf-9291a0c98da8 req-bdf5de13-fa0e-410b-951d-2822fc41f25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b2cb14-6d38-40cf-a791-d315daf65b9c", "name": "network-vif-plugged", "status": "completed", "tag": "f112f7ae-534b-463d-a1ae-edb3cbb1c9f8"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:30.453595 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:30.454596 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:30.454828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5c361656-b637-4295-bfaf-9291a0c98da8 req-bdf5de13-fa0e-410b-951d-2822fc41f25b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:30.455273 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5c361656-b637-4295-bfaf-9291a0c98da8 req-bdf5de13-fa0e-410b-951d-2822fc41f25b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:30.461084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:30.461894 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:30.462847 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:30.463598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:30.490186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-5c361656-b637-4295-bfaf-9291a0c98da8 req-bdf5de13-fa0e-410b-951d-2822fc41f25b service nova] Creating event network-vif-plugged:f112f7ae-534b-463d-a1ae-edb3cbb1c9f8 for instance 17b2cb14-6d38-40cf-a791-d315daf65b9c on hv-cinder-74014 Aug 01 08:08:30.496406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-5c361656-b637-4295-bfaf-9291a0c98da8 req-bdf5de13-fa0e-410b-951d-2822fc41f25b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059557 Aug 01 08:08:30.497016 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 377/761] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:30.609987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:30.620153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-801cb076-a50d-4bb1-9d5f-8c7ddccff627 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.173194 Aug 01 08:08:30.620799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 385/762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:30 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:30.996533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:30.998064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:31.001037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:31.004663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:31.005112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:31.005871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:31.006306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:31.168312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:31.177067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:31.178560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:31.179786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7be4dfca-3c5a-4089-bb58-feba1ca60133 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.187440 Aug 01 08:08:31.180342 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 378/763] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:30 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:31.642154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:31.642793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:31.648771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:31.650927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:31.650927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:31.650927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:31.781392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:31.789200 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d75e6f98-1d41-47c2-810d-0a0bc143be5d tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.151578 Aug 01 08:08:31.789856 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 386/764] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:31 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:32.203686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:32.204296 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:32.211382 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:32.211771 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:32.212571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:32.213003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:32.354224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:32.365042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:32.366935 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:32.368300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a7038578-700f-470d-afa3-3ae6d4c4ad9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.169134 Aug 01 08:08:32.368862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 379/765] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:32 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:32.513494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-2b7c8fb3-7388-499b-8291-5b58bfef996c req-4a8219f3-04e4-42a0-983a-5c6e5451bfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "name": "network-vif-plugged", "status": "completed", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:32.523200 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-2b7c8fb3-7388-499b-8291-5b58bfef996c req-4a8219f3-04e4-42a0-983a-5c6e5451bfa1 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:32.523677 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-2b7c8fb3-7388-499b-8291-5b58bfef996c req-4a8219f3-04e4-42a0-983a-5c6e5451bfa1 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:32.536156 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-2b7c8fb3-7388-499b-8291-5b58bfef996c req-4a8219f3-04e4-42a0-983a-5c6e5451bfa1 service nova] Creating event network-vif-plugged:e9254c41-aa3b-44bb-acda-eff5bfc51cda for instance 0301e609-db16-49d6-8655-2f8033dbadaf on hv-cinder-74014 Aug 01 08:08:32.540948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-2b7c8fb3-7388-499b-8291-5b58bfef996c req-4a8219f3-04e4-42a0-983a-5c6e5451bfa1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Aug 01 08:08:32.541540 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 387/766] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:32.811134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:32.811811 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:32.818108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:32.818556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:32.819388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:32.819848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:32.957932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:32.965473 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-59d7c4e4-3e52-4e4a-acfa-f8aebdc8fea2 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1361 microversion: 2.1 time: 0.159063 Aug 01 08:08:32.973647 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 380/767] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:32 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:33.392538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:33.393229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:33.399585 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:33.400031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:33.400783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:33.401213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:33.557090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:33.565714 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:33.567209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:33.568483 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fdc6e734-4fc9-46cf-9729-8ac2508c97b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.181818 Aug 01 08:08:33.569048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 388/768] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:33 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:33.987194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:33.987846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:33.994247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:33.994700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:33.995587 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:33.996037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:34.132070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:34.140175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6fe7ecda-fc3e-4552-9416-b86c827659f6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1546 microversion: 2.1 time: 0.156823 Aug 01 08:08:34.140845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 381/769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:08:33 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:08:34.161006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:34.161664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:34.171757 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:34.172240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:34.173018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:34.173720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:34.259699 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3740b9ed-1951-46e6-ac72-dd9c2957dabf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102301 Aug 01 08:08:34.260527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 389/770] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:08:34 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:08:34.594495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:34.594495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:34.601319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:34.601775 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:34.603096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:34.603554 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:34.749954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:34.770414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:34.773169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:34.776212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7276d51d-57a9-4661-99b5-1d5bd4b7f73f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1407 microversion: 2.20 time: 0.186818 Aug 01 08:08:34.776212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 382/771] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:34 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:35.515555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-a952044d-45ac-452f-9682-c49bf205804e req-d9c59588-56f7-4a4e-8daa-529c6eae61b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b2cb14-6d38-40cf-a791-d315daf65b9c", "tag": "f112f7ae-534b-463d-a1ae-edb3cbb1c9f8"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:35.520686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:08:35.526268 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-a952044d-45ac-452f-9682-c49bf205804e req-d9c59588-56f7-4a4e-8daa-529c6eae61b6 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:35.526706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-a952044d-45ac-452f-9682-c49bf205804e req-d9c59588-56f7-4a4e-8daa-529c6eae61b6 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:35.539993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-a952044d-45ac-452f-9682-c49bf205804e req-d9c59588-56f7-4a4e-8daa-529c6eae61b6 service nova] Creating event network-changed:f112f7ae-534b-463d-a1ae-edb3cbb1c9f8 for instance 17b2cb14-6d38-40cf-a791-d315daf65b9c on hv-cinder-74014 Aug 01 08:08:35.546766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-a952044d-45ac-452f-9682-c49bf205804e req-d9c59588-56f7-4a4e-8daa-529c6eae61b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.273983 Aug 01 08:08:35.547410 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 390/772] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:35.799771 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:35.801202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:35.813179 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:35.813941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:35.815090 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:35.815740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:36.057904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:36.068266 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:36.070355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:08:36.071515 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e2c017d6-49da-4aef-a0e6-a648c64aab3c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1597 microversion: 2.20 time: 0.276871 Aug 01 08:08:36.073919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 383/773] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:08:35 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1597 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:08:36.094985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:36.095884 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:36.103730 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:36.104511 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:36.105511 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:36.106564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:36.203211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-70f7d291-0f03-4c15-93ef-94334d06cfd2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112571 Aug 01 08:08:36.203852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 391/774] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 1 08:08:36 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:08:37.562814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-36bd3ba4-7feb-46b1-84a3-c5feec1c39ce req-61cfb910-4099-4b47-b825-3f5ccf7ed022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:37.572959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-36bd3ba4-7feb-46b1-84a3-c5feec1c39ce req-61cfb910-4099-4b47-b825-3f5ccf7ed022 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:37.573408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-36bd3ba4-7feb-46b1-84a3-c5feec1c39ce req-61cfb910-4099-4b47-b825-3f5ccf7ed022 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:37.584702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-36bd3ba4-7feb-46b1-84a3-c5feec1c39ce req-61cfb910-4099-4b47-b825-3f5ccf7ed022 service nova] Creating event network-changed:e9254c41-aa3b-44bb-acda-eff5bfc51cda for instance 0301e609-db16-49d6-8655-2f8033dbadaf on hv-cinder-74014 Aug 01 08:08:37.589805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-36bd3ba4-7feb-46b1-84a3-c5feec1c39ce req-61cfb910-4099-4b47-b825-3f5ccf7ed022 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031503 Aug 01 08:08:37.591221 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 384/775] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:43.672016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:08:43.672602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:43.678915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:43.679377 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:43.680169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:43.680608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:43.705026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1f5452bd-87b0-4eda-a6e7-d1da21c41194 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/ips" status: 200 len: 149 microversion: 2.1 time: 0.037520 Aug 01 08:08:43.705587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 392/776] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:08:43 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:08:45.334089 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927200cb-f1a1-4445-a235-07dbc529f2ee"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:08:45.336557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:08:45.342885 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:45.343331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:45.344124 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:08:45.344548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:08:47.349632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-baf9f65c-5d79-4c04-a2e9-c2d8b76667e5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.020292 Aug 01 08:08:47.350248 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 385/777] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:08:45 2022] POST /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments => generated 194 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:01.206944 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927200cb-f1a1-4445-a235-07dbc529f2ee"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:01.209333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:01.211724 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=92 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:01.216704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:01.219162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:01.219162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:01.219162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:01.301032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Invalid volume: volume 927200cb-f1a1-4445-a235-07dbc529f2ee is already attached to instances: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: POST /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments HTTP/1.1 Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 74 Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:09:01.304050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {"volumeAttachment": {"volumeId": "927200cb-f1a1-4445-a235-07dbc529f2ee"}} Aug 01 08:09:01.305611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Invalid volume: volume 927200cb-f1a1-4445-a235-07dbc529f2ee is already attached to instances: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'server_id': '108bb7fc-8fd8-4a7d-80b2-98ca3554a41c', 'body': {'volumeAttachment': {'volumeId': '927200cb-f1a1-4445-a235-07dbc529f2ee'}}} Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 927200cb-f1a1-4445-a235-07dbc529f2ee is already attached to instances: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:09:01.306397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 927200cb-f1a1-4445-a235-07dbc529f2ee is already attached to instances: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:09:01.311929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 927200cb-f1a1-4445-a235-07dbc529f2ee is already attached to instances: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 400 to user: Invalid volume: volume 927200cb-f1a1-4445-a235-07dbc529f2ee is already attached to instances: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-124cd92f-7114-41f8-a21d-b27c4f7f1eac tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102939 Aug 01 08:09:01.313840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 393/778] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:09:01 2022] POST /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:09:01.372915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=14 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:01.374542 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:01.378718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:01.385362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:01.386091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:01.386543 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:01.387320 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:01.387795 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:01.468637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lazy-loading 'services' on Instance uuid 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:09:01.654020 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7da906b1-4f4c-44e4-8cc0-f945c12abdd3 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments/927200cb-f1a1-4445-a235-07dbc529f2ee" status: 202 len: 0 microversion: 2.1 time: 0.282281 Aug 01 08:09:01.654857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 386/779] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:09:01 2022] DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments/927200cb-f1a1-4445-a235-07dbc529f2ee => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:09:01.665076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:01.667384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:01.675231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:01.675639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:01.676484 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:01.676922 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:01.707765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-edadb659-1ea4-41e1-98d7-78eeeb8f837f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047639 Aug 01 08:09:01.708312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 394/780] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:09:01 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:02.722130 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:02.724533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:02.730684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:02.731137 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:02.731932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:02.732377 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:02.767266 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a1d8a795-8fbb-4f85-8c55-53470c1c70fd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051382 Aug 01 08:09:02.767890 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 387/781] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:09:02 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:03.779955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:03.782841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:03.788974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:03.789421 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:03.790180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:03.790619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:03.819745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-41d8da79-caa3-4fad-a46e-a2b5b80b284e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043778 Aug 01 08:09:03.820285 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 395/782] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:09:03 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:09:03.883037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:03.883569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:03.889911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:03.890910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:03.892046 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:03.892474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:03.918188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:09:04.244921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ced63ce3-c690-4359-8db4-ff206033941e tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 204 len: 0 microversion: 2.1 time: 0.365293 Aug 01 08:09:04.245454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 388/783] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:09:03 2022] DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:09:04.254659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:04.255670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:04.261495 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:04.261967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:04.262793 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:04.263230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:04.396117 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:04.403730 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9265f3d6-7847-490b-9f4a-5fb82c508968 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1681 microversion: 2.1 time: 0.152956 Aug 01 08:09:04.404282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 396/784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:04 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:05.427068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:05.427737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:05.434182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:05.439813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:05.439813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:05.439813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:05.574322 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:05.583390 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c7ed0166-e399-49ad-8e54-0973a7ba6e4a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1681 microversion: 2.1 time: 0.160899 Aug 01 08:09:05.584056 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 389/785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:05 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:06.606396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:06.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:06.615573 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:06.620026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:06.620026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:06.620026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:06.764645 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:06.773010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4dd3fc83-a388-4eb7-8163-141a0f3c293d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1681 microversion: 2.1 time: 0.171317 Aug 01 08:09:06.773571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 397/786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:06 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:07.358242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-1b8d26c9-abf1-4c34-b38e-a99a6e59ccaf req-49f2caa0-f108-446a-b62a-5da65787e232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "108bb7fc-8fd8-4a7d-80b2-98ca3554a41c", "name": "network-vif-deleted", "tag": "fb4083ee-220d-4421-93a3-7c627b1f842c"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:07.371862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-1b8d26c9-abf1-4c34-b38e-a99a6e59ccaf req-49f2caa0-f108-446a-b62a-5da65787e232 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:07.373729 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-1b8d26c9-abf1-4c34-b38e-a99a6e59ccaf req-49f2caa0-f108-446a-b62a-5da65787e232 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:07.383991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-1b8d26c9-abf1-4c34-b38e-a99a6e59ccaf req-49f2caa0-f108-446a-b62a-5da65787e232 service nova] Creating event network-vif-deleted:fb4083ee-220d-4421-93a3-7c627b1f842c for instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c on hv-cinder-74014 Aug 01 08:09:07.389045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-1b8d26c9-abf1-4c34-b38e-a99a6e59ccaf req-49f2caa0-f108-446a-b62a-5da65787e232 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034626 Aug 01 08:09:07.390247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 390/787] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:07.800031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:07.801511 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:07.811107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:07.811776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:07.815101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:07.815920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:07.853349 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:07.853800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:07.854247 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lazy-loading 'fault' on Instance uuid 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:09:07.906217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:07.918086 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-144e09f5-79f0-45a5-b176-16f6b081a899 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 200 len: 1331 microversion: 2.1 time: 0.125423 Aug 01 08:09:07.918869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 398/788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:07 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:08.942443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:08.944279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:08.950901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:08.951384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:08.952453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:08.953422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:08.967926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c HTTP/1.1 Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:09:08.976927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:09:08.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '108bb7fc-8fd8-4a7d-80b2-98ca3554a41c'} Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:09:08.979578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:09:08.981149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:09:08.983405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:09:08.984645 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d15f293f-568f-4795-ba7a-0b42c0b17005 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 404 len: 111 microversion: 2.1 time: 0.047829 Aug 01 08:09:08.985455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 391/789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:08 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:09:08.994180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-45e361b7-3ccf-44df-8319-6ffacd239533 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '.version_select at 0x7efe3f56f700>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:09.063266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-45e361b7-3ccf-44df-8319-6ffacd239533 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495958062" status: 202 len: 0 microversion: 2.1 time: 0.072811 Aug 01 08:09:09.063931 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 399/790] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 08:09:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495958062 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:09:10.268191 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-eba5e876-1355-4821-8e80-53b3e602058f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: .version_select at 0x7efe3f280160>, body: {"keypair": {"name": "tempest-keypair-1435480430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPlos82dbgNnAhe8QrTZ2j7u2PhZeKgj0wwihCExHkQSMCaIWmIGvwjeB9ozh7vHeQT15DBGUef8AE03T1tgo6rU8vGcp5t26nCQQnHY4v8cb7ANxrPiLaanhTMHitejw=="}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:10.287904 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-eba5e876-1355-4821-8e80-53b3e602058f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:09:10.292586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-eba5e876-1355-4821-8e80-53b3e602058f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:09:10.377996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-eba5e876-1355-4821-8e80-53b3e602058f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114231 Aug 01 08:09:10.379336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 392/791] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:09:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:12.737771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1695879888", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c1c12be1-af6a-4cc8-84b7-bc9366e80977"}], "security_groups": [{"name": "tempest-securitygroup--1950388862"}], "key_name": "tempest-keypair-1435480430", "user_data": "}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:12.886613 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] validate_networks() for [('c1c12be1-af6a-4cc8-84b7-bc9366e80977', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:09:13.477365 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:09:13.477846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:09:13.478401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:09:13.478867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:09:13.479344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:09:13.488971 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:13.489417 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:13.490221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:13.490688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:13.508658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:09:13.512671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Getting quotas for user 0d2c7d95047445ee9d44640b5372e0e5 and project 7054fc89ba16433bb0669bc6a99044a5. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:09:13.525213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:09:13.527718 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:09:13.694827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-126aa550-583c-4ce6-ab54-4e3306895a49 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.961819 Aug 01 08:09:13.695483 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 400/792] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:09:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:09:13.708160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-beade575-3202-48fd-8031-973e88878642 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:13.709445 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-beade575-3202-48fd-8031-973e88878642 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:13.824830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-beade575-3202-48fd-8031-973e88878642 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:13.832457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-beade575-3202-48fd-8031-973e88878642 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1242 microversion: 2.1 time: 0.129668 Aug 01 08:09:13.833228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 393/793] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:13 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:14.854589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:14.855263 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:14.861996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:14.862452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:14.863226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:14.863779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:14.932446 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:14.939106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bf3a7eaa-9049-4b39-a9ba-14c494d4c064 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1246 microversion: 2.1 time: 0.088481 Aug 01 08:09:14.939720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 401/794] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:14 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:15.960336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:15.962119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:15.969536 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:15.969985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:15.970983 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:15.971615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:16.120289 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:16.131984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5bdd2fa8-8f41-43cb-ba9b-6a9567c7bf11 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1302 microversion: 2.1 time: 0.171913 Aug 01 08:09:16.141034 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 394/795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:15 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1302 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:17.154326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:17.154944 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:17.165057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:17.170755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:17.176812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:17.177144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:17.579985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:17.588173 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-21f478cd-7005-493a-bd8f-f36a3255a98d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.437850 Aug 01 08:09:17.600149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 402/796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:17 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:18.279394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-5fef1d3b-2c1e-4248-bf2e-06ff54f8cf2d req-95a51cd7-4b67-4636-a944-1c6db534a36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d32ef5-feda-4b38-9e5c-df235ecfc2fa", "tag": "07e69be9-00fc-4f3c-8108-a03491b9402e"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:18.290450 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5fef1d3b-2c1e-4248-bf2e-06ff54f8cf2d req-95a51cd7-4b67-4636-a944-1c6db534a36b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:18.291254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5fef1d3b-2c1e-4248-bf2e-06ff54f8cf2d req-95a51cd7-4b67-4636-a944-1c6db534a36b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:18.307563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-5fef1d3b-2c1e-4248-bf2e-06ff54f8cf2d req-95a51cd7-4b67-4636-a944-1c6db534a36b service nova] Creating event network-changed:07e69be9-00fc-4f3c-8108-a03491b9402e for instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa on hv-cinder-74014 Aug 01 08:09:18.315915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-5fef1d3b-2c1e-4248-bf2e-06ff54f8cf2d req-95a51cd7-4b67-4636-a944-1c6db534a36b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040015 Aug 01 08:09:18.319428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 395/797] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:18.616112 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:18.616741 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:18.625207 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:18.625840 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:18.626629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:18.627111 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:18.815256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:18.828973 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7b020b47-fd7d-4666-b507-786f1ea5b56a tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.220347 Aug 01 08:09:18.844461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 403/798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:18 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:19.852460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:19.853254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:19.862128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:19.867668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:19.867668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:19.867668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:20.013475 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:20.022237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0b6caff0-be03-40c0-ad36-f3e6a5ee3cdf tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.173849 Aug 01 08:09:20.026337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 396/799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:19 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:20.958955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-26759ea9-9e90-4b4c-8bfb-736e7ce309ea tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Action: 'create', calling method: .version_select at 0x7efe3f47d310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1395367011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr1cKHKf7uFY/kDJN3eu48oBeK/aFGZfogYeJopbANe+9lg1whI2zzQMatzIxycO2sBvi/siehAfJBtA2RUMEFQfVpzUhq6PFbQg9W+hBOGSg/V9gLWYGs4/btxiopYpg=="}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:20.975483 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-26759ea9-9e90-4b4c-8bfb-736e7ce309ea tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Getting quotas for project eb938950a17942b9b4b1ca56f319e754. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:09:20.979936 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-26759ea9-9e90-4b4c-8bfb-736e7ce309ea tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Getting quotas for user 1bc01a0e20fd411b9df5d2f077784f33 and project eb938950a17942b9b4b1ca56f319e754. Resources: {'key_pairs'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:09:21.049408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:21.051207 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:21.058604 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:21.059290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:21.060163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:21.060603 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:21.090678 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-26759ea9-9e90-4b4c-8bfb-736e7ce309ea tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.305005 Aug 01 08:09:21.091340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 404/800] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:09:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:21.216624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:21.226526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4e718a95-b426-4c27-b727-97944a75ebbe tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.181994 Aug 01 08:09:21.227149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 397/801] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:21 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:22.247276 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:22.247976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:22.254568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:22.255011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:22.255789 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:22.256220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:22.404286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:22.412189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5865d5e5-efd4-47c4-b758-bdb5b24dc284 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.168735 Aug 01 08:09:22.415147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 405/802] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:22 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:23.433832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:23.434449 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:23.441588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:23.442072 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:23.442825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:23.443263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:23.576472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:23.585514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f5594842-52d4-42bf-b0a9-a947b4171802 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.155493 Aug 01 08:09:23.586167 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 398/803] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:23 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:24.607846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:24.608452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:24.610684 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:24.615955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:24.616474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:24.617397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:24.617907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:24.756948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:24.769032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-70c58d35-7001-4632-aedf-44128f452696 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.165057 Aug 01 08:09:24.769714 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 406/804] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:24 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:25.791793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:25.792887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:25.795189 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:25.803081 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:25.803676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:25.804816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:25.805393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:25.964465 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:25.973453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-41e194b3-bdb8-4fcd-aef7-856e901a61e7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.186506 Aug 01 08:09:25.974036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 399/805] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:25 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:09:26.651361 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-dd4166ee-ab22-4b31-99ed-bcd890ab073c req-9a17d09e-68c5-4a42-8372-f74c45ceedbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d32ef5-feda-4b38-9e5c-df235ecfc2fa", "name": "network-vif-plugged", "status": "completed", "tag": "07e69be9-00fc-4f3c-8108-a03491b9402e"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:26.661739 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-dd4166ee-ab22-4b31-99ed-bcd890ab073c req-9a17d09e-68c5-4a42-8372-f74c45ceedbc service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:26.662211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-dd4166ee-ab22-4b31-99ed-bcd890ab073c req-9a17d09e-68c5-4a42-8372-f74c45ceedbc service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:26.673305 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-dd4166ee-ab22-4b31-99ed-bcd890ab073c req-9a17d09e-68c5-4a42-8372-f74c45ceedbc service nova] Creating event network-vif-plugged:07e69be9-00fc-4f3c-8108-a03491b9402e for instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa on hv-cinder-74014 Aug 01 08:09:26.678270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-dd4166ee-ab22-4b31-99ed-bcd890ab073c req-9a17d09e-68c5-4a42-8372-f74c45ceedbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Aug 01 08:09:26.678832 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 407/806] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:26.995739 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:26.996387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:27.004332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:27.007718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:27.007718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:27.007718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:27.153866 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:27.161847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d34ccbb4-9811-414d-a7fe-16c6e1e6396c tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.170323 Aug 01 08:09:27.162426 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 400/807] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:26 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:28.183488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:28.184212 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:28.190485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:28.190932 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:28.191716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:28.192155 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:28.324162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:28.332254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-92c03208-242b-4e5c-90b1-3fb34b5886d7 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1368 microversion: 2.1 time: 0.153095 Aug 01 08:09:28.332808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 408/808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:28 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:29.352539 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:29.353253 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:29.360324 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:29.360798 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:29.362288 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:29.362916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:29.494693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:29.502843 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-79ce9392-6802-4460-ae7f-daca189d5797 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1558 microversion: 2.1 time: 0.154153 Aug 01 08:09:29.503398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 401/809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:29 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:29.523267 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:29.523806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:29.529854 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:29.530411 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:29.531215 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:29.531739 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:29.610246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-efb8f6fb-5647-466b-8993-3eb688dd6381 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090526 Aug 01 08:09:29.610890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 409/810] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 08:09:29 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:30.856575 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-7e970f41-e611-406f-87d6-65ffa19076fc req-ece3d64f-099c-4c50-9a40-974f816f23b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d32ef5-feda-4b38-9e5c-df235ecfc2fa", "tag": "07e69be9-00fc-4f3c-8108-a03491b9402e"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:30.866947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-7e970f41-e611-406f-87d6-65ffa19076fc req-ece3d64f-099c-4c50-9a40-974f816f23b1 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:30.867431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-7e970f41-e611-406f-87d6-65ffa19076fc req-ece3d64f-099c-4c50-9a40-974f816f23b1 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:30.879440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-7e970f41-e611-406f-87d6-65ffa19076fc req-ece3d64f-099c-4c50-9a40-974f816f23b1 service nova] Creating event network-changed:07e69be9-00fc-4f3c-8108-a03491b9402e for instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa on hv-cinder-74014 Aug 01 08:09:30.884533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-7e970f41-e611-406f-87d6-65ffa19076fc req-ece3d64f-099c-4c50-9a40-974f816f23b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 Aug 01 08:09:30.885111 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 402/811] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:47.570065 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=10 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:47.571035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:47.571712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=82 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:47.575638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1869808587", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1395367011", "security_groups": [{"name": "tempest-secgroup-smoke-1942944220"}], "networks": [{"uuid": "afd0c05d-f411-4442-b841-647704e91b6e"}], "block_device_mapping_v2": [{"uuid": "bffe4ff1-9e6b-456a-ab6b-c3089a8e3cbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:47.689616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] validate_networks() for [('afd0c05d-f411-4442-b841-647704e91b6e', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:09:48.058176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:09:48.058601 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:09:48.059257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:09:48.059621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:09:48.064832 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:09:48.068967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:48.069416 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:48.070316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:48.070760 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:48.088974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Getting quotas for project eb938950a17942b9b4b1ca56f319e754. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:09:48.092929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Getting quotas for user 1bc01a0e20fd411b9df5d2f077784f33 and project eb938950a17942b9b4b1ca56f319e754. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:09:48.166985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:09:48.169113 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bffe4ff1-9e6b-456a-ab6b-c3089a8e3cbd',volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:09:48.508933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-19ac54ae-8b27-48a5-8d5a-ab3044a09688 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.939585 Aug 01 08:09:48.509573 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 410/812] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:09:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:09:48.518548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:48.519300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:48.524676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-22271487-9f74-44e8-b184-d105e8e5ca88 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:48.525437 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-22271487-9f74-44e8-b184-d105e8e5ca88 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:48.585336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-22271487-9f74-44e8-b184-d105e8e5ca88 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:48.592232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-22271487-9f74-44e8-b184-d105e8e5ca88 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1089 microversion: 2.1 time: 0.075518 Aug 01 08:09:48.592805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 403/813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:48 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:49.613943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:49.614636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:49.620850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:49.621294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:49.622048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:49.622477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:49.684813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:49.692893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-95ba1e42-5acc-43fc-bf1d-362aa1ce9aaf tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1139 microversion: 2.1 time: 0.083410 Aug 01 08:09:49.693464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 411/814] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:49 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:50.714824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:50.715602 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:50.726911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:50.733091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:50.733091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:50.733091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:50.795684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:50.804261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-162a2ded-a14b-4648-bbe8-1142cc29ab7e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1195 microversion: 2.1 time: 0.093403 Aug 01 08:09:50.804846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 404/815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:50 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1195 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:09:51.827288 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:51.827889 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:51.834121 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:51.834653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:51.835554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:51.836010 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:51.971063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:51.978644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4215c1c9-77d5-417b-8c03-1cf9c39f5989 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1273 microversion: 2.1 time: 0.155265 Aug 01 08:09:51.979227 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 412/816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:51 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:52.442210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-90328081-9621-4f5d-8cd6-41711b5aaf80 req-d6b74019-cf02-4b34-954b-df9c0c42eb68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:09:52.456752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-90328081-9621-4f5d-8cd6-41711b5aaf80 req-d6b74019-cf02-4b34-954b-df9c0c42eb68 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:52.457202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-90328081-9621-4f5d-8cd6-41711b5aaf80 req-d6b74019-cf02-4b34-954b-df9c0c42eb68 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:52.469200 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-90328081-9621-4f5d-8cd6-41711b5aaf80 req-d6b74019-cf02-4b34-954b-df9c0c42eb68 service nova] Creating event network-changed:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:09:52.474319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-90328081-9621-4f5d-8cd6-41711b5aaf80 req-d6b74019-cf02-4b34-954b-df9c0c42eb68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038124 Aug 01 08:09:52.477445 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 405/817] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:09:53.000625 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:53.001351 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:53.007700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:53.008124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:53.008883 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:53.009314 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:53.145497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:53.153180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-21dba1a6-1499-4693-9368-172382a9d0e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.156456 Aug 01 08:09:53.153751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 413/818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:52 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:54.175846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:54.177053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:54.183154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:54.183730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:54.184540 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:54.184987 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:54.314321 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:54.322655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f0c412c5-8f0d-472c-9ade-7f4c78675745 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.151768 Aug 01 08:09:54.333701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 406/819] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:54 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:55.343924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:55.344536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:55.351152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:55.351625 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:55.352384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:55.352819 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:55.482388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:55.490342 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5a327d4d-4351-40a5-ac84-252536fd0f70 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.150245 Aug 01 08:09:55.490894 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 414/820] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:55 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:56.514340 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:56.515495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:56.524392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:56.524822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:56.525658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:56.526098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:56.660770 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:56.669092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-26b9246f-e959-4ac2-9dbe-e147fa88f5f6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.161733 Aug 01 08:09:56.669652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 407/821] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:56 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:57.690700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:57.691303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:57.697721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:57.698163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:57.698905 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:57.699334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:57.830393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:57.837953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-96cb0d2c-3bc6-4869-8e79-7363dd83ea53 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.151090 Aug 01 08:09:57.838522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 415/822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:57 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:09:58.858278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:09:58.858891 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:09:58.861465 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:09:58.866350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:58.866799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:58.867614 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:09:58.868060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:09:59.002137 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:09:59.009991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-78e65628-f0df-4d50-8962-d60ac098e7bb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.155511 Aug 01 08:09:59.022197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 408/823] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:09:58 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:00.031024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:00.031652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:00.033460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:00.034096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=6 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:00.039750 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:00.042558 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:00.042558 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:00.042558 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:00.170943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:00.178813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e43f6a0f-0d0a-4b5e-9a99-0b3294d4868c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.151571 Aug 01 08:10:00.179366 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 416/824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:00 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:01.199381 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:01.200035 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:01.206430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:01.206874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:01.207658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:01.208093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:01.334688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:01.342384 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-882d4c85-8c1c-48ac-b6ca-33a5f491bed9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.146798 Aug 01 08:10:01.342950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 409/825] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:01 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:02.363398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:02.364560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:02.370510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:02.370956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:02.371744 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:02.372176 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:02.498167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:02.506199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f8a4aa4b-1f70-4b5a-bf99-c9ac87f88352 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.146623 Aug 01 08:10:02.506752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 417/826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:02 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:03.527300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:03.527949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:03.534339 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:03.534783 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:03.535549 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:03.536488 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:03.670568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:03.679043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-be826a75-f10b-4202-8b1f-dac47ce577f9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.155533 Aug 01 08:10:03.681837 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 410/827] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:03 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:04.699299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:04.699919 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:04.705868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:04.706305 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:04.707052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:04.707480 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:04.842016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:04.849516 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-174e866e-cba5-4d3b-8f20-594546776923 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.154010 Aug 01 08:10:04.850078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 418/828] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:04 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:04.919830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-597399539", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1537120608", "security_groups": [{"name": "tempest-secgroup-smoke-1037893150"}], "block_device_mapping_v2": [{"uuid": "f0646d6d-db89-4f8a-a266-92321eeb3dee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7b7cb864-a3a9-46e9-bfcd-6745f1953e1a"}]}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:05.031057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] validate_networks() for [('7b7cb864-a3a9-46e9-bfcd-6745f1953e1a', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:10:05.391373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:10:05.391823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:10:05.392297 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:10:05.392705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:10:05.393116 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:10:05.402666 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:05.403114 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:05.403957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:05.404408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:05.422049 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for project 03212885780843bf830a8f030756db97. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:10:05.426219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Getting quotas for user d4d85df24c9e4312bbe2da197f55e116 and project 03212885780843bf830a8f030756db97. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:10:05.481824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:10:05.483949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0646d6d-db89-4f8a-a266-92321eeb3dee',volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:10:05.834585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8d5c46a9-1f68-4a9b-b21f-723dcdf1769e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.919401 Aug 01 08:10:05.835234 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 411/829] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:10:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:10:05.846734 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3aeb4bb9-b38a-4058-be52-182c6f0135de tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:05.847449 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3aeb4bb9-b38a-4058-be52-182c6f0135de tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:05.870612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:05.871300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:05.877742 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:05.878269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:05.881387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:05.881387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:05.900704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3aeb4bb9-b38a-4058-be52-182c6f0135de tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:05.907393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3aeb4bb9-b38a-4058-be52-182c6f0135de tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1094 microversion: 2.1 time: 0.064439 Aug 01 08:10:05.920933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 419/830] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:05 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:06.017479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:06.025364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4ff9b510-8e90-4da6-8a5c-98defab3754d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.159115 Aug 01 08:10:06.025959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 412/831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:05 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:10:06.927335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:06.927898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:06.934050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:06.934490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:06.935238 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:06.935702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:06.998994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:07.006277 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f1b06309-2016-4b0d-9889-d158b127862c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1144 microversion: 2.1 time: 0.082870 Aug 01 08:10:07.006822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 420/832] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:06 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:07.047219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:07.048109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:07.054465 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:07.054910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:07.055691 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:07.056234 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:07.187155 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:07.195285 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1f1ab976-5540-4ac0-a6b7-7aaf23a31a2b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.151855 Aug 01 08:10:07.195887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 413/833] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:07 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:08.028636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:08.029286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:08.035203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:08.035698 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:08.036468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:08.036904 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:08.113931 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:08.122610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4c78a52f-44d0-455d-825a-aa3a6b8f0529 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1210 microversion: 2.1 time: 0.098347 Aug 01 08:10:08.123275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 421/834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:08 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:08.217408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:08.217939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:08.224638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:08.225087 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:08.226007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:08.226440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:08.460022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:08.468250 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2eef04b5-6fe5-4fa0-9427-8d3d7448ce0b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.254941 Aug 01 08:10:08.468842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 414/835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:08 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:08.978700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-063e2995-ceb8-4442-ace1-0e41ca594ae1 req-483ac26f-5a0c-4105-b1d7-c3c9125a512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "name": "network-vif-plugged", "status": "completed", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:08.989755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-063e2995-ceb8-4442-ace1-0e41ca594ae1 req-483ac26f-5a0c-4105-b1d7-c3c9125a512d service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:08.990196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-063e2995-ceb8-4442-ace1-0e41ca594ae1 req-483ac26f-5a0c-4105-b1d7-c3c9125a512d service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:09.004778 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-063e2995-ceb8-4442-ace1-0e41ca594ae1 req-483ac26f-5a0c-4105-b1d7-c3c9125a512d service nova] Creating event network-vif-plugged:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:10:09.010706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-063e2995-ceb8-4442-ace1-0e41ca594ae1 req-483ac26f-5a0c-4105-b1d7-c3c9125a512d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036152 Aug 01 08:10:09.011316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 422/836] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:09.146050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:09.146670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:09.153247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:09.153911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:09.155299 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:09.155929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:09.344661 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:09.354428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bc3d52c7-3ed1-4d02-8e3b-8ffe3801a6e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.212154 Aug 01 08:10:09.355175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 415/837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:09 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:09.490625 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:09.491331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:09.498466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:09.498962 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:09.499769 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:09.500213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:09.638737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:09.646742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-52e356ab-5c4d-4a07-a994-62d678c5b018 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.160283 Aug 01 08:10:09.647335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 423/838] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:09 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:09.872412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-f4efb6e4-8576-4b94-b40a-328a6d4d2878 req-439439b2-0ecc-4571-8984-8a57945ad4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4275be3a-588c-41c0-bd18-f69e64f815cd", "tag": "48952e63-8d30-418d-8121-3c0db27a11ef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:09.881829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-f4efb6e4-8576-4b94-b40a-328a6d4d2878 req-439439b2-0ecc-4571-8984-8a57945ad4d6 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:09.882284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-f4efb6e4-8576-4b94-b40a-328a6d4d2878 req-439439b2-0ecc-4571-8984-8a57945ad4d6 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:09.893670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-f4efb6e4-8576-4b94-b40a-328a6d4d2878 req-439439b2-0ecc-4571-8984-8a57945ad4d6 service nova] Creating event network-changed:48952e63-8d30-418d-8121-3c0db27a11ef for instance 4275be3a-588c-41c0-bd18-f69e64f815cd on hv-cinder-74014 Aug 01 08:10:09.898884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-f4efb6e4-8576-4b94-b40a-328a6d4d2878 req-439439b2-0ecc-4571-8984-8a57945ad4d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030361 Aug 01 08:10:09.899598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 416/839] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:10:10.375633 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:10.376240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:10.382303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:10.382746 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:10.383497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:10.383955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:10.514024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:10.521577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-40fab306-bdc5-4571-98de-86fa535ea682 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.149822 Aug 01 08:10:10.522167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 424/840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:10 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:10.669299 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:10.670003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:10.676433 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:10.676889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:10.677653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:10.678093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:10.809588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:10.817003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ac980c7b-2d0f-4e35-9f65-6ef9d0b31e1d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.152457 Aug 01 08:10:10.817562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 417/841] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:10 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:11.541812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:11.542423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:11.548747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:11.549194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:11.549986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:11.550428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:11.682880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:11.690323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-23eb7475-7b40-439d-859b-7b309e721145 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.152578 Aug 01 08:10:11.696506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 425/842] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:11 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:11.838951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:11.839521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:11.845933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:11.846386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:11.847156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:11.847642 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:11.985560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:11.993085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-59cf9957-63a8-44ed-a6a5-1352747c9b18 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1261 microversion: 2.1 time: 0.158757 Aug 01 08:10:11.994186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 418/843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:11 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:12.711337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:12.712028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:12.718729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:12.719168 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:12.719949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:12.720374 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:12.849510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:12.857689 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-89abfbbb-8b1e-4390-bea5-d3e15351f309 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.150145 Aug 01 08:10:12.858246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 426/844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:12 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:13.016270 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:13.016801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:13.023189 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:13.023670 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:13.024424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:13.025580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:13.155304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:13.163274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c6d844c0-6b7a-42c6-ac7a-db6d4ffeed4b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1445 microversion: 2.1 time: 0.150990 Aug 01 08:10:13.163966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 419/845] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:13 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:13.186987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:13.187620 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:13.193624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:13.194068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:13.194824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:13.195251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:13.326625 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:13.334043 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fce1a9fa-dfef-49ec-9e0d-c4595601897a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1445 microversion: 2.1 time: 0.150910 Aug 01 08:10:13.334614 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 427/846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:13 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:13.878369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:13.879099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:13.886002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:13.886464 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:13.887252 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:13.887734 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:14.035277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:14.044534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6c4b76c4-4598-4816-a8b3-2a05b86569bf tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.170017 Aug 01 08:10:14.045119 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 420/847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:13 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:15.066133 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:15.066721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:15.073178 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:15.073621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:15.074377 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:15.074803 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:15.285799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:15.289274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:15.294249 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-36d5a3a9-dea0-475f-a1cc-7e0507033805 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.231887 Aug 01 08:10:15.294826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 428/848] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:15 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:15.562001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-7a90827e-9fb8-4a17-83e7-982781e4cb0d req-1ef1f81a-88ad-4814-b940-e6672a42b5fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:15.567262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:15.568108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:15.573493 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-7a90827e-9fb8-4a17-83e7-982781e4cb0d req-1ef1f81a-88ad-4814-b940-e6672a42b5fd service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:15.575293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-7a90827e-9fb8-4a17-83e7-982781e4cb0d req-1ef1f81a-88ad-4814-b940-e6672a42b5fd service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:15.585484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-7a90827e-9fb8-4a17-83e7-982781e4cb0d req-1ef1f81a-88ad-4814-b940-e6672a42b5fd service nova] Creating event network-changed:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:10:15.591233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-7a90827e-9fb8-4a17-83e7-982781e4cb0d req-1ef1f81a-88ad-4814-b940-e6672a42b5fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032957 Aug 01 08:10:15.592651 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 421/849] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:16.317052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:16.317658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:16.319423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:16.325033 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:16.325485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:16.326245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:16.326672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:16.468921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:16.476513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-adbec3c2-b6ee-4b0e-a32c-704cb6a88834 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.163641 Aug 01 08:10:16.477083 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 429/850] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:16 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:17.497595 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:17.498302 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:17.505610 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:17.506061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:17.506825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:17.507262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:17.637207 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:17.644597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2e3d9ec0-93a9-436e-bc7b-1fa83e06a67b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.151542 Aug 01 08:10:17.645167 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 422/851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:17 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:17.719919 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:17.720431 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:17.722194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:17.726861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:17.727307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:17.728125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:17.728561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:17.751825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-abccc12a-9a46-421d-a1c9-4c75f24be95e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/ips" status: 200 len: 145 microversion: 2.1 time: 0.035800 Aug 01 08:10:17.752401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 430/852] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:10:17 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:18.666690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:18.667308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:18.674146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:18.674599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:18.675361 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:18.675826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:18.679770 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:18.809138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:18.816507 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-82696aa7-cbc3-45c2-9e52-71dc8e6666d3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.154427 Aug 01 08:10:18.817062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 423/853] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:18 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:19.838375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:19.839113 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:19.845425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:19.845868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:19.846604 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:19.847036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:19.982045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:19.989514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-832d8346-2501-46c0-8978-85a9200044bb tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.156048 Aug 01 08:10:19.990082 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 431/854] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:19 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:20.429048 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:20.432057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:20.438444 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:20.438887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:20.439679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:20.440117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:21.010373 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:21.010942 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:21.016989 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:21.017433 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:21.018217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:21.018690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:21.140205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-316ced36-09d4-4f7b-a391-caf343610adf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714816 Aug 01 08:10:21.140941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 424/855] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:10:20 2022] POST /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:21.153869 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:21.162337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-37faf182-b718-4983-bd21-e2ab7372e65f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.156512 Aug 01 08:10:21.162915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 432/856] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:21 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:10:22.185006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:22.185707 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:22.191953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:22.192406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:22.193160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:22.193600 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:22.331235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:22.338835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f3b2b60f-5955-432d-80b9-e7d25f26bb26 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.159124 Aug 01 08:10:22.339396 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 425/857] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:22 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:23.137469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-59122a40-3dce-4161-a931-50054348f2d6 req-25b10124-9735-4fc7-8c8b-56509e6fdbaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4275be3a-588c-41c0-bd18-f69e64f815cd", "name": "network-vif-plugged", "status": "completed", "tag": "48952e63-8d30-418d-8121-3c0db27a11ef"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:23.146801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-59122a40-3dce-4161-a931-50054348f2d6 req-25b10124-9735-4fc7-8c8b-56509e6fdbaa service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:23.147235 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-59122a40-3dce-4161-a931-50054348f2d6 req-25b10124-9735-4fc7-8c8b-56509e6fdbaa service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:23.160072 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-59122a40-3dce-4161-a931-50054348f2d6 req-25b10124-9735-4fc7-8c8b-56509e6fdbaa service nova] Creating event network-vif-plugged:48952e63-8d30-418d-8121-3c0db27a11ef for instance 4275be3a-588c-41c0-bd18-f69e64f815cd on hv-cinder-74014 Aug 01 08:10:23.165099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-59122a40-3dce-4161-a931-50054348f2d6 req-25b10124-9735-4fc7-8c8b-56509e6fdbaa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 Aug 01 08:10:23.165943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 433/858] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:23.359489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:23.360136 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:23.362543 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:23.367310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:23.367768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:23.371993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:23.371993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:23.700741 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:23.708222 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f8bcf22f-116e-4533-8e88-ddb4a8a20956 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.352636 Aug 01 08:10:23.708977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 426/859] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:23 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:24.729636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:24.730332 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:24.736628 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:24.737078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:24.737836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:24.738291 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:24.871844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:24.879264 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-616c213f-1f55-423e-910c-821019b4b0a6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.153996 Aug 01 08:10:24.879864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 434/860] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:24 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:25.899448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:25.900107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:25.906560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:25.916596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:25.916596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:25.916596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:26.044632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:26.052331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2dc48016-4fa6-49ae-9b7b-f0e2249da532 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1266 microversion: 2.1 time: 0.156721 Aug 01 08:10:26.052892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 427/861] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:25 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:27.080135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:27.080135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:27.080913 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:27.081061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:27.081784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:27.082219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:27.214061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:27.221560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1673c164-92c4-4ff4-a104-4301cfcb13ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1453 microversion: 2.1 time: 0.151954 Aug 01 08:10:27.222283 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 435/862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:27 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:27.243017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:27.243712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:27.252165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:27.252667 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:27.253542 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:27.254065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:27.388496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:27.395817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1d2dbad6-e605-465a-8333-48665f4062fa tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1453 microversion: 2.1 time: 0.156964 Aug 01 08:10:27.396362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 428/863] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:27 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:29.654477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-17e75eca-bead-45d6-a255-54269071a7eb req-223ff0db-372c-4eb5-9aeb-d766e27380bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4275be3a-588c-41c0-bd18-f69e64f815cd", "tag": "48952e63-8d30-418d-8121-3c0db27a11ef"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:29.663943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-17e75eca-bead-45d6-a255-54269071a7eb req-223ff0db-372c-4eb5-9aeb-d766e27380bf service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:29.664529 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-17e75eca-bead-45d6-a255-54269071a7eb req-223ff0db-372c-4eb5-9aeb-d766e27380bf service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:29.687074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-17e75eca-bead-45d6-a255-54269071a7eb req-223ff0db-372c-4eb5-9aeb-d766e27380bf service nova] Creating event network-changed:48952e63-8d30-418d-8121-3c0db27a11ef for instance 4275be3a-588c-41c0-bd18-f69e64f815cd on hv-cinder-74014 Aug 01 08:10:29.692085 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-17e75eca-bead-45d6-a255-54269071a7eb req-223ff0db-372c-4eb5-9aeb-d766e27380bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041717 Aug 01 08:10:29.692831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 436/864] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:29.740926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:29.743208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:29.750328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:29.751023 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:29.752005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:29.752441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:29.784846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-749a6709-17d3-4357-918a-1060b6a62f06 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Aug 01 08:10:29.785398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 429/865] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:10:29 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:29.797627 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:29.798205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:29.805429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:29.806084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:29.806907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:29.807701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:29.839015 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e1378445-a2b7-49c0-aa67-ffc207a95450 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b" status: 200 len: 194 microversion: 2.1 time: 0.045777 Aug 01 08:10:29.839947 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 437/866] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 08:10:29 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:32.528073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfa301ee-02c7-423a-9c32-3867d38e57bb"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:32.530540 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:32.536957 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:32.537410 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:32.538190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:32.538624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:33.289138 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:33.289694 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:33.296705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:33.297153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:33.298214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:33.298648 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:33.310889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3f4417b4-79ed-4b61-856c-9453f56a29e7 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "POST /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.787255 Aug 01 08:10:33.311492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 430/867] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:10:32 2022] POST /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments => generated 194 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:33.323765 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bad0f95b-19a5-45fc-94e2-8a9e0e873bab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/ips" status: 200 len: 150 microversion: 2.20 time: 0.038463 Aug 01 08:10:33.324622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 438/868] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 1 08:10:33 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 08:10:36.452779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:36.453457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:36.459698 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:36.460151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:36.460920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:36.461357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:36.485517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lazy-loading 'flavor' on Instance uuid 0301e609-db16-49d6-8655-2f8033dbadaf {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:10:36.900205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-96124644-b68a-4916-9db0-ac98a84b3808 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/action" status: 202 len: 0 microversion: 2.20 time: 0.452627 Aug 01 08:10:36.900797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 431/869] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 08:10:36 2022] POST /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:10:36.909978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:36.910895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:36.917974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:36.919333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:36.919333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:36.919727 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:37.101293 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:37.109843 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:37.111465 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:37.112654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5fcbf0b7-df7a-4fb3-be72-4aa7d1ac9cd8 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.207639 Aug 01 08:10:37.113208 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 439/870] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:36 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:38.136768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:38.137471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:38.144561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:38.145011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:38.145777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:38.146214 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:38.274664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:38.283229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:38.284840 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:38.286018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bc43efea-2f0c-40c2-ad03-9880a6651ed9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.154586 Aug 01 08:10:38.286564 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 432/871] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:38 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:39.308986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:39.309591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:39.315703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:39.316147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:39.316897 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:39.317328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:39.445725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:39.453522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:39.455001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:39.456231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a776f570-5374-490a-af91-14fbc09814ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.151153 Aug 01 08:10:39.456732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 440/872] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:39 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:40.480175 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:40.480808 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:40.487473 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:40.487955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:40.488751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:40.489194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:40.620359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:40.628045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:40.629534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:40.630675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-73164e0c-86a4-4c1d-8a1d-e662f596c302 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.155038 Aug 01 08:10:40.631217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 433/873] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:40 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:41.653274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:41.662375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:41.662375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:41.662375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:41.662375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:41.662787 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:41.788231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:41.796635 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:41.798367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:41.799506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-176c7b31-50c9-4834-843a-38802f21aa13 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.150168 Aug 01 08:10:41.800079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 441/874] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:41 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:41.900714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:41.903132 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:41.909914 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:41.910305 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:41.911071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:41.911508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:41.942261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-19ed6c57-7a9a-4e70-ac3f-11f93c8fb062 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045977 Aug 01 08:10:41.942805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 434/875] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:10:41 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:42.094710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:42.095190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:42.101103 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:42.101543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:42.102289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:42.102716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:42.131030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-207ec1c6-89fb-4509-aac9-21684974b097 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b" status: 200 len: 194 microversion: 2.1 time: 0.040171 Aug 01 08:10:42.131609 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 442/876] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 08:10:42 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:42.142012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:42.142546 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:42.148604 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:42.149067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:42.149835 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:42.150317 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:42.155864 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:42.233304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lazy-loading 'services' on Instance uuid 17b2cb14-6d38-40cf-a791-d315daf65b9c {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:10:42.432014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-25f148a6-220f-4b93-9296-e170c6fced17 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b" status: 202 len: 0 microversion: 2.1 time: 0.293525 Aug 01 08:10:42.432619 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 435/877] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:10:42 2022] DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/4d7aaaf8-e065-4b2b-85ff-15a9f39cde2b => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:10:42.823221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:42.823922 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:42.829829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:42.830274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:42.831026 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:42.831456 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:42.960159 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:42.968966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:42.970532 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:42.971766 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-caf08ea8-139f-4350-9ef5-5677b25bc1d3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.152947 Aug 01 08:10:42.972328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 443/878] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:42 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:43.995342 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:43.996180 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:44.002608 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:44.003058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:44.003851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:44.004293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:44.136084 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:44.144763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:44.146261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:44.147465 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-75b3fe6b-b9be-44da-9a01-bdf210835aaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.156887 Aug 01 08:10:44.148033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 436/879] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:43 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:44.604777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:44.605226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:44.611372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:44.611860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:44.612638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:44.613148 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:44.643756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2fc7736b-747a-4e81-bee4-ff5eb9211074 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/cfa301ee-02c7-423a-9c32-3867d38e57bb" status: 200 len: 194 microversion: 2.1 time: 0.043143 Aug 01 08:10:44.644325 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 444/880] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 08:10:44 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/cfa301ee-02c7-423a-9c32-3867d38e57bb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:10:44.655546 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:44.658566 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:44.662178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:44.662641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:44.663415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:44.663959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:44.743523 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lazy-loading 'services' on Instance uuid 17b2cb14-6d38-40cf-a791-d315daf65b9c {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:10:44.916925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-21cea87d-5b97-4d15-8dca-01d510cda66a tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/cfa301ee-02c7-423a-9c32-3867d38e57bb" status: 202 len: 0 microversion: 2.1 time: 0.265785 Aug 01 08:10:44.917529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 437/881] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:10:44 2022] DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments/cfa301ee-02c7-423a-9c32-3867d38e57bb => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:10:45.171708 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:45.172570 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:45.178461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:45.178896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:45.179667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:45.180094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:45.312633 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:45.320415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:45.321881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:45.323722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e93f2609-ea3a-4e9d-9bf5-6e040a3f3fcd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.155212 Aug 01 08:10:45.324262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 445/882] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:45 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:46.347096 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:46.347752 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:46.354000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:46.354457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:46.355212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:46.355677 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:46.485802 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:46.493643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:46.495173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:46.496354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3d6630a2-1357-484b-b3c9-c3cb36cfa9ea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.154106 Aug 01 08:10:46.496902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 438/883] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:46 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:47.145231 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:47.147478 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:47.153622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.154169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.155158 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.155647 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.159271 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=91 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:47.185092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-60babd80-7e64-43a0-8626-eb2f2c73e4e4 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043710 Aug 01 08:10:47.185638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 446/884] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:10:47 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:10:47.297560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:47.299860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:47.305842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.306300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.307081 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.308333 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.336397 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-169f896f-26c5-41f9-96c7-b650d3b97baf tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043098 Aug 01 08:10:47.336945 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 439/885] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:10:47 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 08:10:47.397147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:47.397639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:47.404096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.404548 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.405305 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.405741 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.430143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:10:47.520760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:47.521351 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:47.528373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.528827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.529596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.530033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.659659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:47.668392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:47.669889 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:47.671059 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-338886e6-69d5-43b6-8778-715edf9d6fd5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.154154 Aug 01 08:10:47.671633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 440/886] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:47 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:10:47.673259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-1b303c30-082f-4556-9320-119cbee82985 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 204 len: 0 microversion: 2.1 time: 0.279443 Aug 01 08:10:47.676909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 447/887] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:10:47 2022] DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:10:47.681768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:47.682400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:47.688357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.688809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.689570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:47.690010 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:47.822354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:47.830436 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5871ea83-6f80-4315-a1ab-4d22a6aab098 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1671 microversion: 2.1 time: 0.152229 Aug 01 08:10:47.830979 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 441/888] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:47 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:10:48.694829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:48.695584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:48.702403 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:48.702852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:48.703632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:48.704068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:48.832832 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:48.841238 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:48.842721 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:48.843896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-00af0f6a-699c-420a-b272-cb9dbaaee786 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.153335 Aug 01 08:10:48.844455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 448/889] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:48 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:48.851978 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:48.852593 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:48.858984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:48.859434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:48.860350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:48.860786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:48.986725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:48.995073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-91376baa-d6a4-4ecd-b068-c21abbde9d6c tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1671 microversion: 2.1 time: 0.146298 Aug 01 08:10:48.995905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 442/890] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:48 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:49.866795 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:49.867402 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:49.873451 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:49.873889 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:49.874649 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:49.875077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:50.009747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:50.016349 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:50.016986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:50.017695 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:50.019183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:50.020365 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ed09baee-c6f9-4eab-8a48-7ae38f35f0d7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1743 microversion: 2.20 time: 0.157421 Aug 01 08:10:50.020918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 449/891] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:49 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:50.023621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:50.024083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:50.024858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:50.025327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:50.155009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:50.163002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7208f570-9d10-47ce-aaf8-6ca87a102bef tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1671 microversion: 2.1 time: 0.150566 Aug 01 08:10:50.163577 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 443/892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:50 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:10:51.044036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:51.044653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:51.046706 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:51.051899 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:51.052348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:51.053123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:51.053562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:51.124932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-4b1a4dae-ed46-44ba-9028-ed73430ef368 req-e2c6c342-a758-41fe-a6c9-f3456b8fce5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b2cb14-6d38-40cf-a791-d315daf65b9c", "name": "network-vif-deleted", "tag": "f112f7ae-534b-463d-a1ae-edb3cbb1c9f8"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:51.138222 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-4b1a4dae-ed46-44ba-9028-ed73430ef368 req-e2c6c342-a758-41fe-a6c9-f3456b8fce5e service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:51.138922 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-4b1a4dae-ed46-44ba-9028-ed73430ef368 req-e2c6c342-a758-41fe-a6c9-f3456b8fce5e service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:51.153619 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-4b1a4dae-ed46-44ba-9028-ed73430ef368 req-e2c6c342-a758-41fe-a6c9-f3456b8fce5e service nova] Creating event network-vif-deleted:f112f7ae-534b-463d-a1ae-edb3cbb1c9f8 for instance 17b2cb14-6d38-40cf-a791-d315daf65b9c on hv-cinder-74014 Aug 01 08:10:51.158831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-4b1a4dae-ed46-44ba-9028-ed73430ef368 req-e2c6c342-a758-41fe-a6c9-f3456b8fce5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037538 Aug 01 08:10:51.159817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 444/893] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:10:51.192101 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:51.193279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:51.194483 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:51.204283 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:51.205781 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:51.207844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5e4e2514-3e0e-4358-9bd2-e5b3d6c7a1bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1743 microversion: 2.20 time: 0.167236 Aug 01 08:10:51.207966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:51.208076 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:51.208160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 450/894] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:51 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:51.208963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:51.209473 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:51.296903 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f030155981d741f1a42b9b84ca5d6af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '606b2e9ca91341fe9bbe157935c5736e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:51.308635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2a842ccb-2458-4475-9dbe-2c8f520819f0 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 200 len: 1604 microversion: 2.1 time: 0.124131 Aug 01 08:10:51.309218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 445/895] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:51 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 1604 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:10:52.231181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:52.231844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:52.237925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:52.238443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:52.239211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:52.239670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:52.333764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:52.335026 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:52.343993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:52.344453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:52.345240 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:52.345679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:52.361598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] HTTP exception thrown: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Request method failure captured: Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c HTTP/1.1 Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gWQig4jZFCarWcvni1m8DYTpVHkpSsMZ7cp_eQyBiA415Ia0Caccei4sqLuFeIBYNqD8qZv_HzTI1eCiqHVqo0stJdNRFBYSNXtCM4lHi7rqp7gTOHGnoTEAXo8rqO6282NzjHAB2mzWIZRS1pgRRwKWwWAlcMq6gXUn8O5cU2tgM Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:10:52.363172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_606b2e9ca91341fe9bbe157935c5736e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: f030155981d741f1a42b9b84ca5d6af4 Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:52.364899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '17b2cb14-6d38-40cf-a791-d315daf65b9c'} Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:10:52.366043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:52.377675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:52.379246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Returning 404 to user: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:10:52.379246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-87b58c6b-a04f-461c-b456-e17e405c0a50 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 404 len: 111 microversion: 2.1 time: 0.035104 Aug 01 08:10:52.379246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 446/896] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:52 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:10:52.379246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-72fbbd15-ca4c-418e-98d7-aaf82a0da46e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '.version_select at 0x7efe3f334d30>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:52.379771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:52.388338 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:52.389818 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:52.390958 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6d655cfa-5e30-4d31-b046-7b942d75d716 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1743 microversion: 2.20 time: 0.164718 Aug 01 08:10:52.391722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 451/897] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:52 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:52.456641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-72fbbd15-ca4c-418e-98d7-aaf82a0da46e tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200413725" status: 202 len: 0 microversion: 2.1 time: 0.086977 Aug 01 08:10:52.457218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 447/898] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 08:10:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200413725 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 08:10:53.025240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-586d4e54-8d58-4577-9006-b21286422420 req-96173de4-14a9-4416-aacb-558f884287fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "name": "network-vif-plugged", "status": "completed", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:10:53.035940 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-586d4e54-8d58-4577-9006-b21286422420 req-96173de4-14a9-4416-aacb-558f884287fc service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:53.036473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-586d4e54-8d58-4577-9006-b21286422420 req-96173de4-14a9-4416-aacb-558f884287fc service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:53.049382 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-586d4e54-8d58-4577-9006-b21286422420 req-96173de4-14a9-4416-aacb-558f884287fc service nova] Creating event network-vif-plugged:e9254c41-aa3b-44bb-acda-eff5bfc51cda for instance 0301e609-db16-49d6-8655-2f8033dbadaf on hv-cinder-74014 Aug 01 08:10:53.054868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-586d4e54-8d58-4577-9006-b21286422420 req-96173de4-14a9-4416-aacb-558f884287fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Aug 01 08:10:53.055657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 452/899] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:10:53.414373 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:53.414962 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:53.422632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:53.423092 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:53.423872 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:53.424366 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:53.559228 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:53.567282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:53.568816 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:53.569982 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a956a942-d7e3-4d5a-a018-21eea7eda7a4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1743 microversion: 2.20 time: 0.159645 Aug 01 08:10:53.570529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 448/900] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:53 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:54.594722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:54.595463 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:54.601615 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:54.602060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:54.602823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:54.603260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:54.736294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:54.744141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:54.745639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:54.746791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-096a4c36-8e83-4c45-af6f-9c5db66ea40c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1743 microversion: 2.20 time: 0.157162 Aug 01 08:10:54.747334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 453/901] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:54 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:55.770045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:55.770705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:55.773232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:10:55.778544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:55.779001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:55.779901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:55.780331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:55.910286 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:55.918181 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:55.919760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:55.920928 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-112cc9a1-512c-455a-918e-6784a044241a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1743 microversion: 2.20 time: 0.154846 Aug 01 08:10:55.921478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 449/902] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:55 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:55.979376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:55.979988 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:55.985882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:55.986326 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:55.987078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:55.987510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:56.001110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] HTTP exception thrown: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Request method failure captured: Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c HTTP/1.1 Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gWQig4jZFCarWcvni1m8DYTpVHkpSsMZ7cp_eQyBiA415Ia0Caccei4sqLuFeIBYNqD8qZv_HzTI1eCiqHVqo0stJdNRFBYSNXtCM4lHi7rqp7gTOHGnoTEAXo8rqO6282NzjHAB2mzWIZRS1pgRRwKWwWAlcMq6gXUn8O5cU2tgM Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:10:56.002719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_606b2e9ca91341fe9bbe157935c5736e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: f030155981d741f1a42b9b84ca5d6af4 Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.004336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '17b2cb14-6d38-40cf-a791-d315daf65b9c'} Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:10:56.005297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.006775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.009103 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Returning 404 to user: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:10:56.009103 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f771cb05-76c6-45ed-8908-fcb6e97331de tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 404 len: 111 microversion: 2.1 time: 0.028497 Aug 01 08:10:56.009103 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 454/903] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:10:55 2022] DELETE /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:10:56.012937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:56.013489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 17b2cb14-6d38-40cf-a791-d315daf65b9c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:56.019417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:56.019897 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:56.020654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:56.021084 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:56.034428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] HTTP exception thrown: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Request method failure captured: Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c HTTP/1.1 Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gWQig4jZFCarWcvni1m8DYTpVHkpSsMZ7cp_eQyBiA415Ia0Caccei4sqLuFeIBYNqD8qZv_HzTI1eCiqHVqo0stJdNRFBYSNXtCM4lHi7rqp7gTOHGnoTEAXo8rqO6282NzjHAB2mzWIZRS1pgRRwKWwWAlcMq6gXUn8O5cU2tgM Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:10:56.036005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_606b2e9ca91341fe9bbe157935c5736e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: f030155981d741f1a42b9b84ca5d6af4 Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.037571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '17b2cb14-6d38-40cf-a791-d315daf65b9c'} Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:10:56.038574 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. Aug 01 08:10:56.040057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:56.041582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Returning 404 to user: Instance 17b2cb14-6d38-40cf-a791-d315daf65b9c could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:10:56.041582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8c7fb703-3c43-489b-8203-b30f4ffb3441 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c" status: 404 len: 111 microversion: 2.1 time: 0.028912 Aug 01 08:10:56.041582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 450/904] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:56 2022] GET /compute/v2.1/servers/17b2cb14-6d38-40cf-a791-d315daf65b9c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:10:56.944581 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:56.945197 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:56.952762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:56.952762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:56.953312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:56.953641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:57.093688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:57.102000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:57.103488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:57.104716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a504643d-2230-4189-95f3-9238fb9116b7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.164179 Aug 01 08:10:57.105289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 455/905] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:56 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:57.346995 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:57.347502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:57.354021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:57.354477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:57.355310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:57.355797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:57.370631 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] HTTP exception thrown: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Request method failure captured: Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 HTTP/1.1 Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gWQig4jZFCarWcvni1m8DYTpVHkpSsMZ7cp_eQyBiA415Ia0Caccei4sqLuFeIBYNqD8qZv_HzTI1eCiqHVqo0stJdNRFBYSNXtCM4lHi7rqp7gTOHGnoTEAXo8rqO6282NzjHAB2mzWIZRS1pgRRwKWwWAlcMq6gXUn8O5cU2tgM Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:10:57.372231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_606b2e9ca91341fe9bbe157935c5736e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: f030155981d741f1a42b9b84ca5d6af4 Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.373810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '6f414074-c855-47d5-b2f8-ed5bb4b20b50'} Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:10:57.374820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.376534 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.378043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Returning 404 to user: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:10:57.378043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-37a63144-473d-4a34-9a1c-a45dff1be842 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 404 len: 111 microversion: 2.1 time: 0.030540 Aug 01 08:10:57.378043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 451/906] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:10:57 2022] DELETE /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:10:57.383162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:57.383876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] [instance: 6f414074-c855-47d5-b2f8-ed5bb4b20b50] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:57.390636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:57.391357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:57.392038 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:57.392535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:57.407616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] HTTP exception thrown: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Request method failure captured: Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 HTTP/1.1 Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gWQig4jZFCarWcvni1m8DYTpVHkpSsMZ7cp_eQyBiA415Ia0Caccei4sqLuFeIBYNqD8qZv_HzTI1eCiqHVqo0stJdNRFBYSNXtCM4lHi7rqp7gTOHGnoTEAXo8rqO6282NzjHAB2mzWIZRS1pgRRwKWwWAlcMq6gXUn8O5cU2tgM Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:10:57.409209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_606b2e9ca91341fe9bbe157935c5736e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/606b2e9ca91341fe9bbe157935c5736e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 606b2e9ca91341fe9bbe157935c5736e Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-657541934 Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: f030155981d741f1a42b9b84ca5d6af4 Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeTestJSON-657541934-project Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.410696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '6f414074-c855-47d5-b2f8-ed5bb4b20b50'} Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:10:57.411507 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. Aug 01 08:10:57.412830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:10:57.413981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] Returning 404 to user: Instance 6f414074-c855-47d5-b2f8-ed5bb4b20b50 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:10:57.413981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fa46c01d-52b9-44ac-87e8-789dcca948b6 tempest-AttachVolumeTestJSON-657541934 tempest-AttachVolumeTestJSON-657541934-project] 10.222.0.48 "GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50" status: 404 len: 111 microversion: 2.1 time: 0.031951 Aug 01 08:10:57.413981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 456/907] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:10:57 2022] GET /compute/v2.1/servers/6f414074-c855-47d5-b2f8-ed5bb4b20b50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:10:58.128728 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:58.129375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:58.135632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:58.136087 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:58.136849 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:58.137288 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:58.333136 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:58.342267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:58.344079 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:58.345548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-497c2903-eb11-4046-9815-ca15b77a69e5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.220719 Aug 01 08:10:58.360212 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 452/908] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:58 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:10:59.370640 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:10:59.371408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:10:59.383842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:59.384808 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:59.385774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:10:59.386205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:10:59.593571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:59.603674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:59.605097 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:10:59.606583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-859b6850-707b-4196-9073-32dd292578d6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.239872 Aug 01 08:10:59.607132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 457/909] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:10:59 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:00.764888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:00.764888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:00.764888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:00.764888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:00.765632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:00.765632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:00.793016 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:00.803600 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:00.805293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:00.806562 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f85bd369-c7eb-478d-922f-597a8e344751 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.177425 Aug 01 08:11:00.807144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 453/910] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:00 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:01.831284 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:01.831951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:01.838426 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:01.843481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:01.844733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:01.849060 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:02.034470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:02.044297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:02.046286 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:02.048335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f1b69e53-4f4f-4ff1-addb-9143d7cd16c4 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.220716 Aug 01 08:11:02.065542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 458/911] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:01 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:03.076635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:03.079779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:03.088270 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:03.089217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:03.090000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:03.090470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:03.095160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:03.251388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:03.259696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:03.261519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:03.263008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b30a476b-f637-425a-8c12-d956b27c2c3d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.195085 Aug 01 08:11:03.263564 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 454/912] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:03 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:03.922986 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2228c1bd-815d-4931-a069-16a07c981380 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Action: 'create', calling method: .version_select at 0x7efe3f47d430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1570279909", "metadata": {"Type": "work"}}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:11:04.287682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:04.288236 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:04.295501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:04.295972 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:04.296807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:04.297953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:04.428109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:04.436766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:04.438311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:04.439556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8087e259-0e9a-43f6-9f0e-a1f064fa289d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.155955 Aug 01 08:11:04.440116 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 455/913] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:04 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:05.055346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2228c1bd-815d-4931-a069-16a07c981380 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.271256 Aug 01 08:11:05.056559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 459/914] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 08:11:03 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1273 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 01 08:11:05.071806 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cfe493e8-b2fd-47a4-b3a7-50cecb848d0f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f2f81f0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:05.142832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cfe493e8-b2fd-47a4-b3a7-50cecb848d0f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 200 len: 353 microversion: 2.1 time: 0.076792 Aug 01 08:11:05.143344 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 456/915] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:11:05 2022] GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:05.463062 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:05.463747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:05.470490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:05.471184 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:05.471982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:05.472683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:05.617686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:05.626827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:05.628490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:05.629704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-25ff9088-5b14-4c63-bd55-ea192fa9deee tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.170765 Aug 01 08:11:05.630478 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 460/916] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:05 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:06.158003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5369f836-1c97-47ab-a146-ed4b15a1f4d9 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f3b2310>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:06.213537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5369f836-1c97-47ab-a146-ed4b15a1f4d9 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 200 len: 353 microversion: 2.1 time: 0.060236 Aug 01 08:11:06.214539 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 457/917] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:11:06 2022] GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:06.654900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:06.655722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:06.662178 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:06.662943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:06.663800 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:06.664292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:06.811386 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:06.819740 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:06.827589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:06.827589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4947bba9-88bd-4a58-ae6b-aa376e233323 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.172848 Aug 01 08:11:06.827589 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 461/918] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:06 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:07.227696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b6c1069e-bd65-4120-b037-037f804025d8 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f35daf0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:07.275671 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b6c1069e-bd65-4120-b037-037f804025d8 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 200 len: 354 microversion: 2.1 time: 0.052137 Aug 01 08:11:07.276235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 458/919] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:11:07 2022] GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:07.288380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5aaf9542-96e8-49a4-9a3a-8dbb4d6c11c9 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f49c430>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:07.338092 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5aaf9542-96e8-49a4-9a3a-8dbb4d6c11c9 tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 200 len: 354 microversion: 2.1 time: 0.053370 Aug 01 08:11:07.338688 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 462/920] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:11:07 2022] GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:07.355933 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2d73426d-b318-43c8-9d67-fd8791b7662d tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f3b25e0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:07.548586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2d73426d-b318-43c8-9d67-fd8791b7662d tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 202 len: 0 microversion: 2.1 time: 0.195792 Aug 01 08:11:07.557832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 459/921] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:11:07 2022] DELETE /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:11:07.558923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-88d48178-06c4-4922-9d28-2f26bb343a2c tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f464dc0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:07.623690 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-88d48178-06c4-4922-9d28-2f26bb343a2c tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 200 len: 353 microversion: 2.1 time: 0.066319 Aug 01 08:11:07.624454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 463/922] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:11:07 2022] GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:07.851911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:07.852598 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:07.859259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:07.859998 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:07.861045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:07.861789 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:08.021886 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:08.030516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:08.032053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:08.041387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f2d9e85a-3c8d-4345-ab35-f2fe82b81836 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.185736 Aug 01 08:11:08.041387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 460/923] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:07 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:08.639832 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6e1ece64-a25c-48a0-afdb-1df099cb820f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Calling method '.version_select at 0x7efe3f56f8b0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:08.669135 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-6e1ece64-a25c-48a0-afdb-1df099cb820f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] HTTP exception thrown: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6e1ece64-a25c-48a0-afdb-1df099cb820f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Request method failure captured: Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c HTTP/1.1 Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54qXG6W5aHo1IhfdBTwcav7cDofan9VZnhcPe7lsx_34Rkvkp7kgowiaJLLo1fk83h01U8wyZ5QbVpDbWhf0UFD5v2XMEamCtuoWWUpUUZGiJ8pEhfL2Fin9FdZGSLuSrgK90rPu752RiaEygyZmsBbjjrhigYcSD7lOgO5xdRKpB5Q Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: fd818fdc14a84f30816843e3b7279f77 Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesGetTestJSON-1068750529 Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:11:08.672641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd818fdc14a84f30816843e3b7279f77"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fd818fdc14a84f30816843e3b7279f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fd818fdc14a84f30816843e3b7279f77", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fd818fdc14a84f30816843e3b7279f77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesGetTestJSON-1068750529 Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: fd818fdc14a84f30816843e3b7279f77 Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesGetTestJSON-1068750529 Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesGetTestJSON-1068750529-project Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 9710c7e0f16848408b6b17e7c073af56 Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesGetTestJSON-1068750529-project Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': 'eb05f20c-eb98-4845-8e03-071a1f24714c'} Aug 01 08:11:08.674218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. (HTTP 404) (Request-ID: req-419c5a90-1c6d-4d45-87d7-df5eb6638627) Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:11:08.675230 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:11:08.676867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 08:11:08.678674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6e1ece64-a25c-48a0-afdb-1df099cb820f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] Returning 404 to user: Volume eb05f20c-eb98-4845-8e03-071a1f24714c could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6e1ece64-a25c-48a0-afdb-1df099cb820f tempest-VolumesGetTestJSON-1068750529 tempest-VolumesGetTestJSON-1068750529-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c" status: 404 len: 109 microversion: 2.1 time: 0.038339 Aug 01 08:11:08.680331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 464/924] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:11:08 2022] GET /compute/v2.1/os-volumes/eb05f20c-eb98-4845-8e03-071a1f24714c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:11:09.058364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:09.062976 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:09.070973 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:09.071950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:09.074107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:09.074107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:09.247422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:09.258127 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:09.260220 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:09.261831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-80b74461-3fd2-4c5d-9d6a-f0e00c1aa5ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.207347 Aug 01 08:11:09.279900 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 461/925] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:09 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:10.285902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:10.286554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:10.292791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:10.293243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:10.294017 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:10.294454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:10.450828 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:10.459653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:10.461144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:10.462303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-58bd1f81-05fa-4330-a26c-8595971c0bea tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1738 microversion: 2.20 time: 0.181216 Aug 01 08:11:10.462853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 465/926] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:10 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:11.489339 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:11.493537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:11.497181 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:11.497844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:11.498632 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:11.499078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:11.637910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:11.645983 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:11.647466 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:11.648652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f40a8c89-68c1-4a18-bc1d-031f1556a2a3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1720 microversion: 2.20 time: 0.163658 Aug 01 08:11:11.649210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 462/927] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:11 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:12.672143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:12.672786 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:12.679523 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:12.680000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:12.680796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:12.681396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:12.825424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:12.834812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:12.836425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:12.837825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c2bb9655-3fa6-4f79-b1ef-6de78d0d3c50 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1720 microversion: 2.20 time: 0.170149 Aug 01 08:11:12.838443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 466/928] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:12 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:13.861477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:13.862166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:13.869118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:13.869624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:13.870465 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:13.870942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:14.013200 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:14.022583 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:14.024155 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:14.025439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-13689308-68ff-445c-af9e-52c5af4ebb51 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1723 microversion: 2.20 time: 0.167818 Aug 01 08:11:14.025895 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 463/929] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:13 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:14.049015 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12aaa280-7b3a-4270-940e-328707a24a90"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:11:14.052054 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:14.058129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:14.058652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:14.059445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:14.060082 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:14.063874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:15.186911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-8de89933-35fe-47a5-85f7-96541e0eb4e4 req-7c2ee80b-ddca-41e6-98ad-908b7de603b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "name": "network-vif-unplugged", "status": "completed", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:11:15.206672 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-8de89933-35fe-47a5-85f7-96541e0eb4e4 req-7c2ee80b-ddca-41e6-98ad-908b7de603b0 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:15.207357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-8de89933-35fe-47a5-85f7-96541e0eb4e4 req-7c2ee80b-ddca-41e6-98ad-908b7de603b0 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:15.209807 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8a2ac0e4-fbd0-44f0-a05e-77e9fc869c81 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.164720 Aug 01 08:11:15.219408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.compute.server_external_events [req-8de89933-35fe-47a5-85f7-96541e0eb4e4 req-7c2ee80b-ddca-41e6-98ad-908b7de603b0 service nova] Unable to find a host for instance 0301e609-db16-49d6-8655-2f8033dbadaf. Dropping event network-vif-unplugged {{(pid=118233) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 08:11:15.220573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-8de89933-35fe-47a5-85f7-96541e0eb4e4 req-7c2ee80b-ddca-41e6-98ad-908b7de603b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.167283 Aug 01 08:11:15.222079 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 464/930] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 169 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 08:11:15.227307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 467/931] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 1 08:11:14 2022] POST /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-volume_attachments => generated 188 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 08:11:15.342380 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:15.342882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:15.349272 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:15.349728 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:15.350750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:15.351195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:15.957551 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-14183063-b478-4b6d-9e78-fcd7b957004a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-volume_attachments/12aaa280-7b3a-4270-940e-328707a24a90" status: 202 len: 0 microversion: 2.20 time: 0.619087 Aug 01 08:11:15.958146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 465/932] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 1 08:11:15 2022] DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-volume_attachments/12aaa280-7b3a-4270-940e-328707a24a90 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:11:16.043990 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:11:16.044984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:16.053667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:16.054151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:16.054921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:16.055357 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:16.102076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118232) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 08:11:16.324592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fc5e7ea4-b69b-4a6b-b306-adfcdc0b0184 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "POST /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/action" status: 202 len: 0 microversion: 2.20 time: 0.287248 Aug 01 08:11:16.325264 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 468/933] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 08:11:16 2022] POST /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:11:16.333425 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:16.334037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:16.342213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:16.342213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:16.342434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:16.342704 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:16.484845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:16.493700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:16.495201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:16.496410 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-97031336-7927-46fa-ba3a-25cdbbf39912 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1671 microversion: 2.20 time: 0.167095 Aug 01 08:11:16.502705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 466/934] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:16 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:17.521213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:17.521213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:17.527030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:17.527473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:17.528263 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:17.528698 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:17.660512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:17.668692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:17.670179 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:17.671344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6d41a119-93ee-48d6-a264-7296880331a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1671 microversion: 2.20 time: 0.155605 Aug 01 08:11:17.672177 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 469/935] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:17 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:18.695140 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:18.695902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:18.702623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:18.703161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:18.703956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:18.704398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:18.920503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:18.929338 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:18.930841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:18.932080 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0ea31515-d39c-4d56-a569-2e3bb178551b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.241550 Aug 01 08:11:18.932671 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 467/936] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:18 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:19.966052 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:19.968762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:19.983659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:19.985599 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:19.987129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:19.989192 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:20.148935 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:20.157317 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:20.158802 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:20.160499 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-69f96be8-fc2e-4c95-875e-083a525a453f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.207203 Aug 01 08:11:20.161419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 470/937] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:19 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:20.548790 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:20.549362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:20.555813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:20.556270 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:20.557037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:20.557481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:20.579554 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-de305730-5224-47cd-a28d-ded6b3518001 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/ips" status: 200 len: 149 microversion: 2.1 time: 0.034922 Aug 01 08:11:20.580100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 468/938] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:11:20 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:21.190473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:21.191148 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:21.197445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:21.197896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:21.198663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:21.199097 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:21.330072 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:21.338480 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:21.340028 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:21.341174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7b8f0a1e-c8b6-4c8c-8cad-31add66134a5 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.154824 Aug 01 08:11:21.341733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 471/939] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:21 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:22.366255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:22.366871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:22.380065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:22.380525 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:22.381612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:22.382241 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:22.522305 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:22.530122 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:22.531635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:22.532791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5226cbb7-0d04-49b2-bda1-ade7bc2f321c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.171019 Aug 01 08:11:22.533368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 469/940] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:22 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:23.556526 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:23.557134 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:23.558950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:23.563684 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:23.564131 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:23.564882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:23.565309 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:23.693953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:23.702123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:23.703573 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:23.704726 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7d275674-c84a-49fe-b17e-9443579d2acd tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.152065 Aug 01 08:11:23.705283 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 472/941] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:23 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:24.728627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:24.729173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:24.735372 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:24.735860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:24.736608 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:24.737044 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:24.865055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:24.873041 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:24.874541 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:24.875745 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a3c9afe0-c8a6-41a4-9b73-8c91db352ac3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.151076 Aug 01 08:11:24.876300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 470/942] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:24 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:25.900012 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:25.900752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:25.907118 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:25.907598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:25.908378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:25.908821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:26.048950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:26.057618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:26.059094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:26.060276 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f87a8b6b-fddf-4502-a3a9-b9481fabe44a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.164216 Aug 01 08:11:26.060839 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 473/943] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:25 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:27.084226 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:27.085690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:27.092487 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=36 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:27.095054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:27.095650 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:27.096557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:27.097165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:27.259729 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:27.268231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:27.270022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:27.272267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-23b9d6ec-1ea3-4b85-9f10-ebcbd3410e84 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.192857 Aug 01 08:11:27.275021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 471/944] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:27 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:27.465032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "937dafc4-080a-40e4-a92d-80a97fffda64"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:11:27.467437 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:27.474577 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:27.475113 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:27.475834 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:27.476264 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:28.296084 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:28.297001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:28.303638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:28.304099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:28.304892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:28.305335 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:28.430863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:28.438801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:28.440369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:28.441533 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f4fb919f-4ba4-448a-bafa-79e14f319504 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.149317 Aug 01 08:11:28.442821 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 472/945] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:28 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:29.464311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:29.465009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:29.471400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:29.471882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:29.472643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:29.473083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:29.487548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:29.601860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:29.609757 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:29.611295 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:29.612492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0eafd69c-a718-4faa-b9cd-b3b158b09266 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.152130 Aug 01 08:11:29.613043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 473/946] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:29 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:30.637275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:30.638798 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:30.646363 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:30.647197 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:30.648067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:30.648586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:30.804804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:30.815748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:30.817675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:30.819282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-35bc64a1-7aa0-4599-b981-f91b7e7f4cd3 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.186119 Aug 01 08:11:30.820239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 474/947] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:30 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:31.842345 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:31.843011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:31.850397 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:31.850841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:31.851638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:31.852063 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:31.987084 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:31.996151 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:31.997668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:31.998852 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-934d2306-91bd-4d74-a3ff-da88c3514eba tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.160470 Aug 01 08:11:31.999749 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 475/948] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:31 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:33.022350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:33.023036 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:33.030133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:33.030590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:33.031365 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:33.031840 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:33.165861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:33.173997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:33.175509 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:33.177391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f4d47f25-0a7f-4bb5-bcd1-beb2f34cd2fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.158922 Aug 01 08:11:33.177954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 476/949] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:33 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:34.202366 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:34.204086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:34.212479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:34.212924 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:34.213685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:34.214122 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:34.362448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:34.370312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:34.371855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:34.373007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a7b09d12-cce6-4207-8970-15db44db93bc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.175847 Aug 01 08:11:34.373565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 477/950] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:34 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:35.397148 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:35.397841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:35.411710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:35.411710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:35.411710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:35.411710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:35.550640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:35.567846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:35.569367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:35.570768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-96bb2eeb-9eab-4eb6-91c3-44464d03e407 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.177804 Aug 01 08:11:35.571332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 478/951] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:35 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:36.594322 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:36.595054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:36.602165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:36.628190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:36.628190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:36.628190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:36.775085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:36.783398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:36.785066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:36.786723 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fab63ea6-d8fb-45ad-900f-653474b3549c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.196251 Aug 01 08:11:36.787294 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 479/952] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:36 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:37.471977 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=5 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:37.548749 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:37.810265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:37.810937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:37.818711 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:37.819211 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:37.820007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:37.820451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:37.946509 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:37.954511 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:37.956053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:37.957256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0657f36a-5673-4afa-b874-808d7533643e tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.150989 Aug 01 08:11:37.957814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 480/953] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:37 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:38.979805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:38.980469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:38.986886 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:38.987386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:38.988177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:38.989136 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:39.119413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:39.127346 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:39.128888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:39.130678 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ba83fd52-a427-40ec-b1d0-6253d3d035a1 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.154852 Aug 01 08:11:39.131233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 481/954] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:38 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:40.153903 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:40.154624 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:40.161925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:40.162380 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:40.163161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:40.163633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:40.295726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:40.303805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:40.305580 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:40.306732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-eeb33447-7696-4e8c-9924-a171d78b852a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.156825 Aug 01 08:11:40.307284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 482/955] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:40 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:41.330441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:41.331149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:41.338565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:41.339050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:41.339869 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:41.340314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:41.477269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:41.485074 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:41.486558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:41.487797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-955e7d47-a67f-4795-b9c3-4663e8df06dc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.161372 Aug 01 08:11:41.488299 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 483/956] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:41 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:42.510591 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:42.511249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:42.517696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:42.518146 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:42.518913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:42.519355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:42.652248 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:42.660609 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:42.662914 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:42.664227 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7238ccba-47e6-4bdf-b757-89459c5d2306 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.157628 Aug 01 08:11:42.668479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 484/957] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:42 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:43.687635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:43.689209 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:43.695393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:43.695888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:43.696665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:43.697115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:43.826254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:43.834333 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:43.838714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:43.838714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f3b73d6f-1cae-4931-a4b8-4fdc44d05f12 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.153285 Aug 01 08:11:43.838714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 485/958] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:43 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:44.859822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:44.859822 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:44.872371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:44.872371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:44.873513 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:44.873943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:45.014942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:45.026557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:45.028066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:45.029421 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4a3d145f-04cb-4b3f-9117-9d30b89b07b0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.174073 Aug 01 08:11:45.029999 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 486/959] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:44 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:45.515393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6a347713-2244-453f-aea3-e4bbc85a11b6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "POST /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 18.054153 Aug 01 08:11:45.516111 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 474/960] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:11:27 2022] POST /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments => generated 194 bytes in 18056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:11:46.054517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:46.055061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:46.061740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:46.062196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:46.062964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:46.063405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:46.197551 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:46.205519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:46.207315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:46.208831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-3a0e7bb4-287d-4473-b72b-659fa8817ef6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.158880 Aug 01 08:11:46.209401 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 487/961] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:46 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:47.233950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:47.234645 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:47.241497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:47.241946 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:47.242716 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:47.243203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:47.370398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:47.378288 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:47.379815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:47.381498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2aaf64ef-3633-4137-afe8-7753d4f6a0fc tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.152405 Aug 01 08:11:47.382048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 475/962] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:47 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:11:48.403702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:48.404323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:48.410778 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:48.411307 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:48.412105 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:48.412545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:48.541072 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:48.549138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:48.550631 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:48.552516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e083dd2c-a528-4728-ae2d-3590a0962371 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.151984 Aug 01 08:11:48.553060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 488/963] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:48 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:49.575122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:49.575744 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:49.582195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:49.582630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:49.583657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:49.584098 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:49.714005 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:49.721676 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:49.723146 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:49.724380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dfbde7f4-b860-42a1-8197-440471443972 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.153183 Aug 01 08:11:49.724925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 476/964] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:49 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:50.748057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:50.748782 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:50.755159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:50.755637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:50.756404 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:50.756930 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:50.891672 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:50.899716 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:50.901206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:50.902362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bb3b6fc1-fcae-4124-a19b-b699d7b8d3f7 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.158184 Aug 01 08:11:50.902912 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 489/965] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:50 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:51.255780 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-d276df37-6462-4be9-a32f-fba421c6248a req-cae535fb-0555-48cf-8e4f-3b911fb80942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "name": "network-vif-plugged", "status": "completed", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:11:51.265784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-d276df37-6462-4be9-a32f-fba421c6248a req-cae535fb-0555-48cf-8e4f-3b911fb80942 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:51.266220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-d276df37-6462-4be9-a32f-fba421c6248a req-cae535fb-0555-48cf-8e4f-3b911fb80942 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:51.279389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-d276df37-6462-4be9-a32f-fba421c6248a req-cae535fb-0555-48cf-8e4f-3b911fb80942 service nova] Creating event network-vif-plugged:e9254c41-aa3b-44bb-acda-eff5bfc51cda for instance 0301e609-db16-49d6-8655-2f8033dbadaf on hv-cinder-74014 Aug 01 08:11:51.284440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-d276df37-6462-4be9-a32f-fba421c6248a req-cae535fb-0555-48cf-8e4f-3b911fb80942 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032279 Aug 01 08:11:51.285024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 477/966] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:11:51.940043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:51.940043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:51.940043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:51.940043 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:51.940813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:51.940813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:51.940813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:52.064640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:52.073732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:52.075281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:52.076484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f0ba90a6-4eaa-4fca-b7e1-c68a36888e8d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.154624 Aug 01 08:11:52.077044 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 490/967] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:51 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:53.099156 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:53.100064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:53.106466 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:53.106917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:53.107718 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:53.108158 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:53.242448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:53.252037 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:53.253512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:53.260602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9f472aa2-f717-4884-a029-ea7b6f0d7825 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.160180 Aug 01 08:11:53.260602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 478/968] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:53 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:54.278908 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:54.279428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:54.286005 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:54.286448 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:54.287777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:54.288341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:54.417169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:54.425216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:54.426701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:54.427947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2739188a-1a47-47d5-9957-7c4f809cfaaa tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.152917 Aug 01 08:11:54.428803 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 491/969] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:54 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:55.450278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:55.450921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:55.457393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:55.457841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:55.458598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:55.459732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:55.589559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:55.597455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:55.598950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:55.600918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-40d92b23-0b3f-4702-9e2f-9d9e7b042c7f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.154467 Aug 01 08:11:55.601477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 479/970] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:55 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:56.623387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:56.624164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:56.631378 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:56.631931 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:56.632658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:56.633100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:56.758787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:56.766798 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:56.768331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:56.769489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6de08db6-4ef1-4c76-9292-5ef3e4a1f00b tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.150055 Aug 01 08:11:56.770038 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 492/971] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:56 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:57.793701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:57.794304 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:57.800652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:57.801088 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:57.801835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:57.802260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:57.929822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:57.937578 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:57.939102 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:57.940318 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e7b31be3-1608-4094-95d5-28ed861547f9 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.150969 Aug 01 08:11:57.940876 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 480/972] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:57 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:11:58.963263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:11:58.964669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:11:58.967012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=44 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:11:58.971868 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:58.972314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:58.973083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:11:58.973518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:11:59.106279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:59.114470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:59.116012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:11:59.117763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5b82c969-3303-4c21-8834-c83aa821b0ae tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1729 microversion: 2.20 time: 0.159315 Aug 01 08:11:59.118316 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 493/973] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:11:58 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:12:00.141926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:00.142514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:00.149868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:00.150312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:00.151071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:00.151506 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:00.280004 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:00.287937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:00.289594 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:00.290742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f3e30840-baad-424a-8f0b-9f25aacda54f tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1716 microversion: 2.20 time: 0.152715 Aug 01 08:12:00.291301 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 481/974] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:12:00 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1716 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:12:00.541053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:00.541553 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:00.548328 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:00.548781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:00.549552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:00.550024 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:00.628694 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lazy-loading 'services' on Instance uuid e5d32ef5-feda-4b38-9e5c-df235ecfc2fa {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:12:00.819166 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4661ce93-3c75-45d7-8b12-ce29ae8352eb tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments/937dafc4-080a-40e4-a92d-80a97fffda64" status: 202 len: 0 microversion: 2.1 time: 0.281764 Aug 01 08:12:00.823244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 494/975] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:12:00 2022] DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments/937dafc4-080a-40e4-a92d-80a97fffda64 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:12:00.839705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:00.841937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:00.850404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:00.850404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:00.850404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:00.850404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:00.879733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5b52353b-e15d-4f11-aac9-875cda5950f2 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053335 Aug 01 08:12:00.880290 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 482/976] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:12:00 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:12:01.893899 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:01.896323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:01.903693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:01.904155 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:01.904932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:01.905374 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:01.937875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ceb2d014-d864-4939-bd01-5c690360051d tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048526 Aug 01 08:12:01.938450 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 495/977] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:12:01 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:12:02.950313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:02.952513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:02.958954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:02.959405 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:02.960201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:02.960641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:02.989472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-844dcaab-3ea3-4cc1-8bac-31c4ad620bcd tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043142 Aug 01 08:12:02.989982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 483/978] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:12:02 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:12:03.051033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:03.051586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:03.058162 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:03.058606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:03.059372 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:03.059838 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:03.084194 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:12:03.384934 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-766cbb23-ebef-4e97-948c-e8b1a6cf1840 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 204 len: 0 microversion: 2.1 time: 0.337459 Aug 01 08:12:03.385529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 496/979] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:12:03 2022] DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:12:03.394065 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:03.394704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:03.400870 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:03.401315 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:03.402161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:03.403106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:03.533655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:03.541009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-521938b7-f96b-4721-822c-7557f1f8b0c0 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1682 microversion: 2.1 time: 0.150725 Aug 01 08:12:03.541567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 484/980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:03 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:04.568989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:04.568989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:04.570947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:04.571429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:04.572239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:04.572684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:04.728638 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:04.736176 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1fcdbc55-afbe-455d-903e-2c5bf11e6b83 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1682 microversion: 2.1 time: 0.176849 Aug 01 08:12:04.736742 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 497/981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:04 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:05.758027 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:05.759244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:05.767893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:05.768348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:05.769127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:05.769565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:05.900713 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:05.909217 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f05e7f23-6f29-4c12-9434-488c3b2f0b42 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1682 microversion: 2.1 time: 0.156170 Aug 01 08:12:05.909781 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 485/982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:05 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:06.930273 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:06.931518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:06.939481 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:06.940250 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:06.941348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:06.941994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:07.258943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:07.269613 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-17757f22-c222-4526-9916-eca655ef1d7f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1614 microversion: 2.1 time: 0.343194 Aug 01 08:12:07.270157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 498/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:06 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1614 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:07.468262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-068eec0a-1cec-42e6-b30c-d40b68ee7739 req-992b7aa2-2488-4c3e-a2ca-89098b0eebda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d32ef5-feda-4b38-9e5c-df235ecfc2fa", "name": "network-vif-deleted", "tag": "07e69be9-00fc-4f3c-8108-a03491b9402e"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:07.478978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-068eec0a-1cec-42e6-b30c-d40b68ee7739 req-992b7aa2-2488-4c3e-a2ca-89098b0eebda service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:07.479752 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-068eec0a-1cec-42e6-b30c-d40b68ee7739 req-992b7aa2-2488-4c3e-a2ca-89098b0eebda service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:07.491211 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-068eec0a-1cec-42e6-b30c-d40b68ee7739 req-992b7aa2-2488-4c3e-a2ca-89098b0eebda service nova] Creating event network-vif-deleted:07e69be9-00fc-4f3c-8108-a03491b9402e for instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa on hv-cinder-74014 Aug 01 08:12:07.497129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-068eec0a-1cec-42e6-b30c-d40b68ee7739 req-992b7aa2-2488-4c3e-a2ca-89098b0eebda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241602 Aug 01 08:12:07.498522 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 486/984] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:12:08.293954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:08.294568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:08.301387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:08.301944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:08.302729 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:08.303172 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:08.338815 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:08.339275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:08.339858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lazy-loading 'fault' on Instance uuid e5d32ef5-feda-4b38-9e5c-df235ecfc2fa {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:12:08.382110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d2c7d95047445ee9d44640b5372e0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7054fc89ba16433bb0669bc6a99044a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:08.390733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-433b72d9-857c-42c1-ab9e-0a4063030aba tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 200 len: 1332 microversion: 2.1 time: 0.101166 Aug 01 08:12:08.391808 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 499/985] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:08 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:09.412799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:09.413502 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:09.415519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=25 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:09.421685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:09.422138 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:09.422910 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:09.423346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:09.429576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:09.437423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa HTTP/1.1 Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:09.439087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:09.440861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': 'e5d32ef5-feda-4b38-9e5c-df235ecfc2fa'} Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:09.441796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:09.443434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:09.444887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:09.444887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6ef13dd2-7d90-40e0-a558-666e6639098b tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 404 len: 111 microversion: 2.1 time: 0.032439 Aug 01 08:12:09.444887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 487/986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:09 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:09.450814 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-268b22df-e99c-4c61-8017-1739f1678880 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '.version_select at 0x7efe3f54e1f0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:09.523249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-268b22df-e99c-4c61-8017-1739f1678880 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435480430" status: 202 len: 0 microversion: 2.1 time: 0.076560 Aug 01 08:12:09.523939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 500/987] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 08:12:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435480430 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:12:11.613571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:11.614055 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:11.621671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:11.622110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:11.622858 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:11.624153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:11.637576 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa HTTP/1.1 Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:11.639833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.641462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': 'e5d32ef5-feda-4b38-9e5c-df235ecfc2fa'} Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:11.642306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.643519 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.644836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:11.644836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3d36cc57-6a7b-4c25-ad0a-e01cce997471 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 404 len: 111 microversion: 2.1 time: 0.031463 Aug 01 08:12:11.644836 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 488/988] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:12:11 2022] DELETE /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:11.649643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:11.650263 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: e5d32ef5-feda-4b38-9e5c-df235ecfc2fa] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:11.657768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:11.663502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:11.663502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:11.663502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:11.673008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa HTTP/1.1 Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:11.674684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.676368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': 'e5d32ef5-feda-4b38-9e5c-df235ecfc2fa'} Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:11.677326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. Aug 01 08:12:11.678942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:11.680680 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance e5d32ef5-feda-4b38-9e5c-df235ecfc2fa could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:11.680680 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c77ebae9-be48-4123-ada7-cb83d9b3a1e8 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa" status: 404 len: 111 microversion: 2.1 time: 0.030301 Aug 01 08:12:11.680680 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 501/989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:11 2022] GET /compute/v2.1/servers/e5d32ef5-feda-4b38-9e5c-df235ecfc2fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 08:12:12.934888 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:12.935408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:12.943269 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:12.946512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:12.946512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:12.946512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:12.959271 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c HTTP/1.1 Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:12.963794 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.965404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '108bb7fc-8fd8-4a7d-80b2-98ca3554a41c'} Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:12.966414 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.967686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:12.969058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:12.969058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f298be3a-fa57-40bc-b192-2f697254bb76 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 404 len: 111 microversion: 2.1 time: 0.031729 Aug 01 08:12:12.969058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 489/990] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:12:12 2022] DELETE /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:12.971284 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:12.971936 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:12.978396 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:12.978851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:12.979658 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:12.980106 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:12.995989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c HTTP/1.1 Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:12.997508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:12.999158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '108bb7fc-8fd8-4a7d-80b2-98ca3554a41c'} Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:13.001011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. Aug 01 08:12:13.002478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.004009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 108bb7fc-8fd8-4a7d-80b2-98ca3554a41c could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:13.004009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d87e11e2-b730-4e80-b1f4-78ef05d6bf95 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c" status: 404 len: 111 microversion: 2.1 time: 0.031825 Aug 01 08:12:13.004009 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 502/991] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:12 2022] GET /compute/v2.1/servers/108bb7fc-8fd8-4a7d-80b2-98ca3554a41c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:13.008127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:13.008644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:13.014958 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:13.015979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:13.016798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:13.017226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:13.030154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 HTTP/1.1 Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:13.031705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.033353 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '6267fc83-1b64-48ea-85bc-2c8eb64b8505'} Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:13.034415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.035951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.037671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:13.037671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9691feff-0f3f-4f35-a3d2-45f739cf31f6 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 404 len: 111 microversion: 2.1 time: 0.028697 Aug 01 08:12:13.037671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 490/992] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:12:13 2022] DELETE /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:13.041563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:13.042189 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 6267fc83-1b64-48ea-85bc-2c8eb64b8505] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:13.048575 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:13.049313 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:13.050090 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:13.050531 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:13.064435 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 HTTP/1.1 Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:13.065941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.067569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '6267fc83-1b64-48ea-85bc-2c8eb64b8505'} Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:13.068719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. Aug 01 08:12:13.070210 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:13.071753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 6267fc83-1b64-48ea-85bc-2c8eb64b8505 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:13.071753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-48988460-0a79-47f1-b0a5-e80220128b70 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505" status: 404 len: 111 microversion: 2.1 time: 0.029830 Aug 01 08:12:13.071753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 503/993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:13 2022] GET /compute/v2.1/servers/6267fc83-1b64-48ea-85bc-2c8eb64b8505 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:14.328619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:14.329127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:14.335602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:14.337040 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:14.337040 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:14.337336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:14.350580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 HTTP/1.1 Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:14.352141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.353801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '518e1fe8-c4a4-4e72-9984-324ab59f6683'} Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:14.354618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.355924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.357175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:14.357175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ea21eafa-e55a-4087-9454-ddc1c7a1613f tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 404 len: 111 microversion: 2.1 time: 0.029353 Aug 01 08:12:14.357175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 491/994] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:12:14 2022] DELETE /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:14.366559 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:14.367153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] [instance: 518e1fe8-c4a4-4e72-9984-324ab59f6683] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:14.373952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:14.374944 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:14.376601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:14.377075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:14.391499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] HTTP exception thrown: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Request method failure captured: Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 HTTP/1.1 Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54gUM8cCHECK5-CKsdexrLeANpLrAtCYf4Z6WEbM0l6bu-onNQkDzbjpHil3nRAqSASILFTxZs96_rMXmyAcdch2hlGrO-lV_8KjzhshYuqyA1_Gx2beO7TRHTvzTo6FdkCZB5oika3bqFjE2iKOmVVq4re8DrCu2m_WqMJW9YZwlUc Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:14.393133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7054fc89ba16433bb0669bc6a99044a5", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7054fc89ba16433bb0669bc6a99044a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 7054fc89ba16433bb0669bc6a99044a5 Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-736144496 Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 0d2c7d95047445ee9d44640b5372e0e5 Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeNegativeTest-736144496-project Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.395653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '518e1fe8-c4a4-4e72-9984-324ab59f6683'} Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:14.397327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. Aug 01 08:12:14.400118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:14.402362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] Returning 404 to user: Instance 518e1fe8-c4a4-4e72-9984-324ab59f6683 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:14.402362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cad07ca2-d452-4b02-a2fa-b5f5d6cd06d5 tempest-AttachVolumeNegativeTest-736144496 tempest-AttachVolumeNegativeTest-736144496-project] 10.222.0.48 "GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683" status: 404 len: 111 microversion: 2.1 time: 0.032511 Aug 01 08:12:14.402362 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 504/995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:14 2022] GET /compute/v2.1/servers/518e1fe8-c4a4-4e72-9984-324ab59f6683 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:19.955761 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bae6bdad-0b58-4dd6-bfd5-7fa41df7904a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Action: 'create', calling method: .version_select at 0x7efe47cf74c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1447951613", "metadata": {"Type": "work"}}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bae6bdad-0b58-4dd6-bfd5-7fa41df7904a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Request method failure captured: Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 122 Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54rjZyNcFcN24c4--FKwacvx1HxXxuohkl3tnaC4Vg3a5NdSc17pEWhOjgoeTmMeEdgWZmNuWNiasH9MnbBIwyJKzY3g_eQNE1fcqXcUkEyaH1X136mFYDzZiYl2nPU7yAqbnHf6pP-utZNOfaCVd_8mnotPV5UBOoeuq5IGZM8JDys Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:19.964949 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2187f7d16c64ac294ecd6c8ef228f63", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 139a19677d184593a2bbd46cd6dc451a Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1447951613", "metadata": {"Type": "work"}}} Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:12:19.973024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1447951613', 'metadata': {'Type': 'work'}}}} Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise error Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:19.974149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 08:12:19.975846 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 08:12:19.977303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 08:12:19.977303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.977303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bae6bdad-0b58-4dd6-bfd5-7fa41df7904a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:19.977303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bae6bdad-0b58-4dd6-bfd5-7fa41df7904a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127445 Aug 01 08:12:19.977303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 492/996] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 08:12:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:12:19.979702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c6114d77-8a27-4eca-88a8-beb66ca3567a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Action: 'create', calling method: .version_select at 0x7efe3f781160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1733560417", "metadata": {"Type": "work"}}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c6114d77-8a27-4eca-88a8-beb66ca3567a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Request method failure captured: Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 120 Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54rjZyNcFcN24c4--FKwacvx1HxXxuohkl3tnaC4Vg3a5NdSc17pEWhOjgoeTmMeEdgWZmNuWNiasH9MnbBIwyJKzY3g_eQNE1fcqXcUkEyaH1X136mFYDzZiYl2nPU7yAqbnHf6pP-utZNOfaCVd_8mnotPV5UBOoeuq5IGZM8JDys Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:19.984726 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2187f7d16c64ac294ecd6c8ef228f63", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 139a19677d184593a2bbd46cd6dc451a Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1733560417", "metadata": {"Type": "work"}}} Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: Aug 01 08:12:19.986915 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1733560417', 'metadata': {'Type': 'work'}}}} Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise error Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi '0' Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:19.987896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 08:12:19.989476 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 08:12:19.990744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 08:12:19.990744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:19.990744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c6114d77-8a27-4eca-88a8-beb66ca3567a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:19.990744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c6114d77-8a27-4eca-88a8-beb66ca3567a tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012300 Aug 01 08:12:19.990744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 505/997] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 08:12:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:12:19.997811 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5d675b9a-b8d0-41a1-b763-518702d4fa29 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Action: 'create', calling method: .version_select at 0x7efe47d048b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1156595904", "metadata": {"Type": "work"}}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5d675b9a-b8d0-41a1-b763-518702d4fa29 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Request method failure captured: Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 119 Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54rjZyNcFcN24c4--FKwacvx1HxXxuohkl3tnaC4Vg3a5NdSc17pEWhOjgoeTmMeEdgWZmNuWNiasH9MnbBIwyJKzY3g_eQNE1fcqXcUkEyaH1X136mFYDzZiYl2nPU7yAqbnHf6pP-utZNOfaCVd_8mnotPV5UBOoeuq5IGZM8JDys Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:20.003152 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2187f7d16c64ac294ecd6c8ef228f63", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 139a19677d184593a2bbd46cd6dc451a Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1156595904", "metadata": {"Type": "work"}}} Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:12:20.004849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1156595904', 'metadata': {'Type': 'work'}}}} Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise error Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi '' Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:20.005995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 08:12:20.007413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 08:12:20.009068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 08:12:20.009068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.009068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5d675b9a-b8d0-41a1-b763-518702d4fa29 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:20.009068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5d675b9a-b8d0-41a1-b763-518702d4fa29 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010694 Aug 01 08:12:20.009068 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 493/998] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 08:12:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:12:20.014181 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0fef94a1-6a5f-40a5-bf51-60e1cfcfcd62 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Calling method '.version_select at 0x7efe3f54e3a0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:20.046548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-0fef94a1-6a5f-40a5-bf51-60e1cfcfcd62 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] HTTP exception thrown: Volume tempest-invalid-1341321327 could not be found. Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0fef94a1-6a5f-40a5-bf51-60e1cfcfcd62 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Request method failure captured: Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1341321327 HTTP/1.1 Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54rjZyNcFcN24c4--FKwacvx1HxXxuohkl3tnaC4Vg3a5NdSc17pEWhOjgoeTmMeEdgWZmNuWNiasH9MnbBIwyJKzY3g_eQNE1fcqXcUkEyaH1X136mFYDzZiYl2nPU7yAqbnHf6pP-utZNOfaCVd_8mnotPV5UBOoeuq5IGZM8JDys Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:20.048907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2187f7d16c64ac294ecd6c8ef228f63", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 139a19677d184593a2bbd46cd6dc451a Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Volume tempest-invalid-1341321327 could not be found. Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': 'tempest-invalid-1341321327'} Aug 01 08:12:20.050503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1341321327 could not be found. (HTTP 404) (Request-ID: req-cf18b4ef-731d-498a-baff-f3af0cafe86e) Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.051688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 08:12:20.053177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1341321327 could not be found. Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:20.054430 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1341321327 could not be found. Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1341321327 could not be found. Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-0fef94a1-6a5f-40a5-bf51-60e1cfcfcd62 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Returning 404 to user: Volume tempest-invalid-1341321327 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-0fef94a1-6a5f-40a5-bf51-60e1cfcfcd62 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1341321327" status: 404 len: 99 microversion: 2.1 time: 0.040014 Aug 01 08:12:20.055920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 506/999] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 08:12:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1341321327 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 08:12:20.059919 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-236b1701-5b45-4e63-83fe-3a474292e208 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003823 Aug 01 08:12:20.060408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 494/1000] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 1 08:12:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 08:12:20.069494 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-86e6ff2b-5f79-44cb-9cb4-a2abb2ebfed3 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003940 Aug 01 08:12:20.069985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 507/1001] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Aug 1 08:12:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 08:12:20.078447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-046fa294-3a2c-4905-a4ef-a03ff4d57f4e tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Calling method '.version_select at 0x7efe47cf7310>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:20.108412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-046fa294-3a2c-4905-a4ef-a03ff4d57f4e tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] HTTP exception thrown: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-046fa294-3a2c-4905-a4ef-a03ff4d57f4e tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Request method failure captured: Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/os-volumes/0f8157d3-f605-418a-9d61-ada12246372d HTTP/1.1 Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54rjZyNcFcN24c4--FKwacvx1HxXxuohkl3tnaC4Vg3a5NdSc17pEWhOjgoeTmMeEdgWZmNuWNiasH9MnbBIwyJKzY3g_eQNE1fcqXcUkEyaH1X136mFYDzZiYl2nPU7yAqbnHf6pP-utZNOfaCVd_8mnotPV5UBOoeuq5IGZM8JDys Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:12:20.110829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2187f7d16c64ac294ecd6c8ef228f63", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 139a19677d184593a2bbd46cd6dc451a Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '0f8157d3-f605-418a-9d61-ada12246372d'} Aug 01 08:12:20.112497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. (HTTP 404) (Request-ID: req-e338e3da-4126-4a31-bbe2-37231c601f04) Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.118260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 08:12:20.120324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 08:12:20.121985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-046fa294-3a2c-4905-a4ef-a03ff4d57f4e tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Returning 404 to user: Volume 0f8157d3-f605-418a-9d61-ada12246372d could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-046fa294-3a2c-4905-a4ef-a03ff4d57f4e tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0f8157d3-f605-418a-9d61-ada12246372d" status: 404 len: 109 microversion: 2.1 time: 0.037572 Aug 01 08:12:20.123321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 495/1002] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:12:20 2022] DELETE /compute/v2.1/os-volumes/0f8157d3-f605-418a-9d61-ada12246372d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:20.125085 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-65e026ea-7f69-4272-9123-d3914b9e1055 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Calling method '.version_select at 0x7efe3f54ea60>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:20.152586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-65e026ea-7f69-4272-9123-d3914b9e1055 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] HTTP exception thrown: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-65e026ea-7f69-4272-9123-d3914b9e1055 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Request method failure captured: Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/os-volumes/b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 HTTP/1.1 Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54rjZyNcFcN24c4--FKwacvx1HxXxuohkl3tnaC4Vg3a5NdSc17pEWhOjgoeTmMeEdgWZmNuWNiasH9MnbBIwyJKzY3g_eQNE1fcqXcUkEyaH1X136mFYDzZiYl2nPU7yAqbnHf6pP-utZNOfaCVd_8mnotPV5UBOoeuq5IGZM8JDys Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:12:20.154526 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a2187f7d16c64ac294ecd6c8ef228f63", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a2187f7d16c64ac294ecd6c8ef228f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: a2187f7d16c64ac294ecd6c8ef228f63 Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesNegativeTest-569790005 Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 139a19677d184593a2bbd46cd6dc451a Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesNegativeTest-569790005-project Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': 'b734e5d9-afb3-4ada-bfa1-1691fc2a25b0'} Aug 01 08:12:20.165907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. (HTTP 404) (Request-ID: req-3ba0732b-9cd7-473c-8ed8-e751a95bad29) Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.166955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:12:20.168451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 08:12:20.171312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-65e026ea-7f69-4272-9123-d3914b9e1055 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] Returning 404 to user: Volume b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-65e026ea-7f69-4272-9123-d3914b9e1055 tempest-VolumesNegativeTest-569790005 tempest-VolumesNegativeTest-569790005-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b734e5d9-afb3-4ada-bfa1-1691fc2a25b0" status: 404 len: 109 microversion: 2.1 time: 0.035202 Aug 01 08:12:20.173440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 508/1003] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:12:20 2022] GET /compute/v2.1/os-volumes/b734e5d9-afb3-4ada-bfa1-1691fc2a25b0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:12:48.339921 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=9 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:48.340660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=9 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:48.344556 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-595783381", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "networks": [{"uuid": "0bc763cf-0ca7-4382-93d1-72a9a8469962"}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:48.395306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] validate_networks() for [('0bc763cf-0ca7-4382-93d1-72a9a8469962', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:12:48.808865 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:12:48.809280 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:12:48.809774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:12:48.810390 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:12:48.810877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:12:48.820640 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:48.821083 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:48.821875 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:48.822310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:48.840143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Getting quotas for project 5e81732f21c54f07bbd838396f6cb0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:12:48.844487 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Getting quotas for user 54a4d08f57a24222ac7f28c57cbe3c64 and project 5e81732f21c54f07bbd838396f6cb0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:12:48.856193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:12:48.858441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:12:48.956867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a6405011-4775-469b-b7a4-04f1ae1778ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618874 Aug 01 08:12:48.957503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 496/1004] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:12:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:12:48.966123 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:48.968470 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:48.972495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-88b3e59e-3a5e-4a93-a285-d813303e86a9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:48.973112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-88b3e59e-3a5e-4a93-a285-d813303e86a9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:49.034984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-88b3e59e-3a5e-4a93-a285-d813303e86a9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:49.042911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-88b3e59e-3a5e-4a93-a285-d813303e86a9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1218 microversion: 2.1 time: 0.078315 Aug 01 08:12:49.043586 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 509/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:48 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:50.064896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:50.066100 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:50.073664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:50.074112 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:50.074889 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:50.075324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:50.140209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:50.148847 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8b589c82-86f1-4712-8188-e6993ce1f897 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1222 microversion: 2.1 time: 0.087649 Aug 01 08:12:50.153170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 497/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:50 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:51.169303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:51.170753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:51.179215 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:51.179686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:51.180471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:51.180911 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:51.255492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:51.263439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-36ed5043-3bf3-410b-bfb4-39740072efd4 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1288 microversion: 2.1 time: 0.098175 Aug 01 08:12:51.264032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 510/1007] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:51 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:12:52.286485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:52.286485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:52.293909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:52.294363 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:52.295478 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:52.296064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:52.435571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:52.448100 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-927b80df-5dae-4d68-b2ce-a0eb1c2bc8b6 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.167362 Aug 01 08:12:52.448672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 498/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:52 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:52.455465 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-5bf6fb3b-64ab-4670-82a7-fa4fca864a6c req-facc38f5-50ef-4ba0-bf6a-5f46ef7a0138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a645d07-2702-41b4-b4f0-991d102f6544", "tag": "fc885c8c-34b9-4395-8df9-39a461b1e308"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:52.477168 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5bf6fb3b-64ab-4670-82a7-fa4fca864a6c req-facc38f5-50ef-4ba0-bf6a-5f46ef7a0138 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:52.477603 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5bf6fb3b-64ab-4670-82a7-fa4fca864a6c req-facc38f5-50ef-4ba0-bf6a-5f46ef7a0138 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:52.488777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-5bf6fb3b-64ab-4670-82a7-fa4fca864a6c req-facc38f5-50ef-4ba0-bf6a-5f46ef7a0138 service nova] Creating event network-changed:fc885c8c-34b9-4395-8df9-39a461b1e308 for instance 2a645d07-2702-41b4-b4f0-991d102f6544 on hv-cinder-74014 Aug 01 08:12:52.494218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-5bf6fb3b-64ab-4670-82a7-fa4fca864a6c req-facc38f5-50ef-4ba0-bf6a-5f46ef7a0138 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050095 Aug 01 08:12:52.495002 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 511/1009] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:12:53.476768 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:53.477472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:53.484579 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:53.485023 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:53.485781 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:53.486213 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:53.617294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:53.624778 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-399d2c20-6c6c-4239-b3a7-edc1ec50f98b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.153113 Aug 01 08:12:53.625335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 499/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:53 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:54.645857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:54.646557 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:54.653628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:54.654071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:54.654827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:54.655260 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:54.792487 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:54.800215 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6396ab69-40e7-40bb-b206-cd682d65f30f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.158691 Aug 01 08:12:54.800777 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 512/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:54 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:55.821709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:55.822423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:55.828975 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:55.829413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:55.830163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:55.830591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:55.957095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:55.964660 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8e0859ff-c812-4602-9dfd-c48841d3fa7d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.147596 Aug 01 08:12:55.965223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 500/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:55 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:56.984736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:56.985352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:56.991985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:56.992434 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:56.993198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:56.993635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:57.119421 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:57.127093 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5c709544-a9d3-4c72-ad06-b9cdffe2d74d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.146248 Aug 01 08:12:57.127735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 513/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:56 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:58.150901 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:58.151517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:58.157630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:58.158073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:58.158829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:58.159266 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:58.293223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:58.301020 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c5452e4e-01d0-4317-9469-cb7e59f85fa8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.154731 Aug 01 08:12:58.301591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 501/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:58 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:59.321848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:12:59.322469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:12:59.324919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:59.329735 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:59.330189 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:59.330961 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:59.331405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:59.466577 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:12:59.474069 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6ad697d8-73df-4712-9032-799ca60eff2c tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.156116 Aug 01 08:12:59.475163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 514/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:12:59 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:12:59.667220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-5e497fca-b4bf-41e5-a91f-9cbdf7a7ccb7 req-7420e559-9d90-4f08-930f-e8311db9890a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a645d07-2702-41b4-b4f0-991d102f6544", "name": "network-vif-plugged", "status": "completed", "tag": "fc885c8c-34b9-4395-8df9-39a461b1e308"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:12:59.672585 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:59.673314 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=6 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:12:59.679080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-5e497fca-b4bf-41e5-a91f-9cbdf7a7ccb7 req-7420e559-9d90-4f08-930f-e8311db9890a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:12:59.679542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-5e497fca-b4bf-41e5-a91f-9cbdf7a7ccb7 req-7420e559-9d90-4f08-930f-e8311db9890a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:12:59.690331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-5e497fca-b4bf-41e5-a91f-9cbdf7a7ccb7 req-7420e559-9d90-4f08-930f-e8311db9890a service nova] Creating event network-vif-plugged:fc885c8c-34b9-4395-8df9-39a461b1e308 for instance 2a645d07-2702-41b4-b4f0-991d102f6544 on hv-cinder-74014 Aug 01 08:12:59.695477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-5e497fca-b4bf-41e5-a91f-9cbdf7a7ccb7 req-7420e559-9d90-4f08-930f-e8311db9890a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031955 Aug 01 08:12:59.696085 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 502/1016] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:00.496058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:00.496676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:00.503077 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:00.503546 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:00.504311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:00.504747 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:00.632754 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:00.640237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5ee5e884-a452-4411-9b6d-7992a6152580 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.148044 Aug 01 08:13:00.640794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 515/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:00 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:01.663238 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:01.663963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:01.670995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:01.671444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:01.672227 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:01.672661 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:01.803652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:01.811031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-41ba0622-6387-4b46-ab12-975b300eab60 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1318 microversion: 2.1 time: 0.153294 Aug 01 08:13:01.811598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 503/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:01 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:02.831183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:02.831820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:02.838560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:02.839006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:02.839859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:02.840304 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:02.971078 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:02.979045 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6ce0ecca-be6b-4384-96e1-18398d57dc2e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1507 microversion: 2.1 time: 0.151711 Aug 01 08:13:02.979629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 516/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:02 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:20.147791 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:20.148452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:20.150606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-682e670d-7724-4d09-99a8-4bc52884169e req-30c86405-6fde-4997-bd0e-4bbbe7ee2b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4275be3a-588c-41c0-bd18-f69e64f815cd", "tag": "48952e63-8d30-418d-8121-3c0db27a11ef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:20.151036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:20.151868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=40 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:20.156352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=18 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:20.157293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=38 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:20.157912 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.158583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.159454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.160004 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.163059 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-682e670d-7724-4d09-99a8-4bc52884169e req-30c86405-6fde-4997-bd0e-4bbbe7ee2b4b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.163809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-682e670d-7724-4d09-99a8-4bc52884169e req-30c86405-6fde-4997-bd0e-4bbbe7ee2b4b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.175854 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-682e670d-7724-4d09-99a8-4bc52884169e req-30c86405-6fde-4997-bd0e-4bbbe7ee2b4b service nova] Creating event network-changed:48952e63-8d30-418d-8121-3c0db27a11ef for instance 4275be3a-588c-41c0-bd18-f69e64f815cd on hv-cinder-74014 Aug 01 08:13:20.181879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-682e670d-7724-4d09-99a8-4bc52884169e req-30c86405-6fde-4997-bd0e-4bbbe7ee2b4b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035909 Aug 01 08:13:20.182418 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 517/1020] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:20.191399 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:13:20.460209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8257a55c-f753-43f1-b54e-25dcd7fb6be5 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 204 len: 0 microversion: 2.1 time: 0.315715 Aug 01 08:13:20.461672 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 504/1021] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:13:20 2022] DELETE /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:13:20.476712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:20.477549 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:20.485021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.490233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.490233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.490233 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.684969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:20.692588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7b3c7fe2-02b4-415f-a557-a18927f4e69b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.221277 Aug 01 08:13:20.693371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 518/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:20 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:20.786779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:20.787878 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:20.793695 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.794502 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.795396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:20.795879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:20.819780 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lazy-loading 'flavor' on Instance uuid 1208d5e5-44c4-4a20-808f-f2c798a96f61 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:21.096339 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a271cdd8-459b-4a51-aab6-7ba2e2f507e5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "POST /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61/action" status: 202 len: 0 microversion: 2.1 time: 0.314038 Aug 01 08:13:21.096928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 505/1023] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:13:20 2022] POST /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:13:21.105998 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:21.106730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:21.112844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:21.115319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:21.115319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:21.115319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:21.251807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:21.259676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8c9bcdf8-b1fb-42bd-a913-ac7e09c893ab tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.157509 Aug 01 08:13:21.260235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 519/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:21 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:21.717738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:21.718388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:21.724554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:21.725005 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:21.725763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:21.726203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:21.862398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:21.870251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-93162ecb-4743-43a9-8909-654c2a8951e3 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.157268 Aug 01 08:13:21.870821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 506/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:21 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:22.280999 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:22.281611 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:22.288080 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:22.288692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:22.289458 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:22.294516 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:22.422386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:22.430462 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-056eade8-e144-4dc8-89a4-ea5a36a3d422 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.152811 Aug 01 08:13:22.431270 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 520/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:22 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:22.897196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:22.897812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:22.904464 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:22.904918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:22.905705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:22.906144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:23.034755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:23.042890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-91e2760d-b3de-4136-895d-2e17d76466dc tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.149537 Aug 01 08:13:23.043455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 507/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:22 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:23.452281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:23.452936 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:23.459356 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:23.459865 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:23.460660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:23.461150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:23.600563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:23.609121 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a26f7e0a-e1ed-444d-98a2-078952e89306 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.160649 Aug 01 08:13:23.609679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 521/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:23 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:24.065399 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:24.066073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:24.072536 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:24.075438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:24.075438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:24.075438 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:24.208295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:24.216581 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-13718a5b-efe6-44f2-918e-c59df9726dff tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.155255 Aug 01 08:13:24.217142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 508/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:24 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:24.631730 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:24.632969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:24.639927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:24.640387 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:24.641159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:24.641643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:24.774874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:24.782453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a7c7ac1e-8790-44ba-ba11-6b31cd6806d1 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.154755 Aug 01 08:13:24.782994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 522/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:24 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:25.238096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:25.238712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:25.245367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:25.245814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:25.246570 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:25.247006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:25.379035 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:25.387216 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-61c56ca5-f06e-4bc6-bfb3-f13df962320d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.153121 Aug 01 08:13:25.387805 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 509/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:25 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:25.806832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:25.807569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:25.814405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:25.814884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:25.815701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:25.816143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:25.951688 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:25.959398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-753e1d7d-9e62-4107-a426-731ea1caaa5b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.158610 Aug 01 08:13:25.960001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 523/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:25 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:26.409120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:26.409728 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:26.416704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:26.417171 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:26.417925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:26.418351 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:26.600923 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:26.608641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9c9dda80-c48f-486a-bf9d-3122f7000440 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.203392 Aug 01 08:13:26.609425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 510/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:26 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:26.981350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:26.981970 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:26.988609 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:26.989068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:26.989842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:26.990285 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:27.125599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:27.133281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-746ce82e-6259-4174-95a2-e5cabb6347e6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.155863 Aug 01 08:13:27.133848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 524/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:26 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:27.629926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:27.630779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:27.637983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:27.638557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:27.639384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:27.639906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:27.702799 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-00a69fe6-1e44-4abd-ba3d-b7c14059c6f5 req-ec6f49d1-d599-449f-bb42-b8fb32da0b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4275be3a-588c-41c0-bd18-f69e64f815cd", "name": "network-vif-unplugged", "status": "completed", "tag": "48952e63-8d30-418d-8121-3c0db27a11ef"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:27.714617 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-00a69fe6-1e44-4abd-ba3d-b7c14059c6f5 req-ec6f49d1-d599-449f-bb42-b8fb32da0b0a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:27.715195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-00a69fe6-1e44-4abd-ba3d-b7c14059c6f5 req-ec6f49d1-d599-449f-bb42-b8fb32da0b0a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:27.728523 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-00a69fe6-1e44-4abd-ba3d-b7c14059c6f5 req-ec6f49d1-d599-449f-bb42-b8fb32da0b0a service nova] Creating event network-vif-unplugged:48952e63-8d30-418d-8121-3c0db27a11ef for instance 4275be3a-588c-41c0-bd18-f69e64f815cd on hv-cinder-74014 Aug 01 08:13:27.733875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-00a69fe6-1e44-4abd-ba3d-b7c14059c6f5 req-ec6f49d1-d599-449f-bb42-b8fb32da0b0a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038092 Aug 01 08:13:27.736838 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 525/1035] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:27.782263 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:27.790735 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-36d7b81b-5519-46ae-a2f5-56fe7425abd7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.164544 Aug 01 08:13:27.792698 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 511/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:27 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:28.038473 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:28.041441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:28.047940 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.048392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.049370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.049634 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.080813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-29ce1c41-052a-40dc-bbdf-12b6d5f40a7d tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047424 Aug 01 08:13:28.081573 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 526/1037] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 08:13:28 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:28.143700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:28.144197 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:28.150598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.151072 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.151867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.152306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.157482 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:28.158098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:28.164364 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.164685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.166344 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.166715 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.178497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:13:28.306003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:28.313585 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-389fe0a6-6b46-4dce-a0bc-0449726bf13b tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.160063 Aug 01 08:13:28.314149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 527/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:28 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:28.463943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-67ba697d-9d8d-42a6-bbd1-6d85a9c1bad0 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 204 len: 0 microversion: 2.20 time: 0.323924 Aug 01 08:13:28.464561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 512/1039] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 08:13:28 2022] DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 08:13:28.472721 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:28.473451 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:28.480774 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.481293 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.482129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.482654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.614171 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:28.622226 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:28.623781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:28.624953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-77d9ce44-1549-4bed-9cbe-05da1c7fbb15 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.156075 Aug 01 08:13:28.625518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 528/1040] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:28 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:13:28.812756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:28.813441 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:28.819883 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.820371 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.821119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:28.822064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:28.952306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:28.959729 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7e8599d2-e435-4d4c-9baf-3d91e275548c tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.151109 Aug 01 08:13:28.960284 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 513/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:28 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:29.335255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:29.335939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:29.342379 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:29.342844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:29.343618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:29.344059 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:29.476311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:29.484303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-421ad898-0640-4c3c-9a96-ad91412832d3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.152966 Aug 01 08:13:29.484878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 529/1042] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:29 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:29.650517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:29.651129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:29.657392 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:29.657850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:29.658611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:29.659046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:29.787711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:29.795939 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:29.797424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:29.798571 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-898946cd-4962-46f1-a0ae-bc5f103e4704 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.152168 Aug 01 08:13:29.799130 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 514/1043] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:29 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:13:29.980855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:29.981485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:29.987520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:29.988004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:29.988775 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:29.989218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:30.119207 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:30.126745 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7e0aab2f-6bad-4540-b803-05ba47b675d0 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.149988 Aug 01 08:13:30.127312 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 530/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:29 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:30.505779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:30.506388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:30.513024 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:30.513469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:30.514226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:30.514663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:30.518661 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:30.658149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:30.666603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dcdfc5c6-d388-4963-a0b1-dfad7420c021 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.164092 Aug 01 08:13:30.669739 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 515/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:30 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:30.669855 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1826851619", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:30.719641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] validate_networks() for None {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:13:30.822548 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:30.823263 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:30.829657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:30.830192 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:30.830972 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:30.831404 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:30.969194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:30.978320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:30.980146 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:30.981497 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-71c86cc6-694e-460c-84f2-cd835cd4d923 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.163084 Aug 01 08:13:30.982257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 516/1046] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:30 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:13:31.149319 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:31.150095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:31.156350 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:31.156801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:31.157565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:31.158106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:31.229273 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:13:31.229695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:13:31.230163 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:13:31.230567 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:13:31.230974 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:13:31.239813 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:31.240112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:31.240902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:31.241338 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:31.258857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Getting quotas for project 1c39845babd94c3898cd13c8b2f0132e. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:13:31.262824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Getting quotas for user 1a878dfa39f546708f65af0cf6abff8c and project 1c39845babd94c3898cd13c8b2f0132e. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:13:31.274064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:13:31.276902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:13:31.294860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:31.302614 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-92028765-4f1c-4260-8fa6-3e1916f476d2 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.157272 Aug 01 08:13:31.303175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 517/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:31 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:31.430187 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4283671a-80f8-41eb-840e-2921d9a2686d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767777 Aug 01 08:13:31.431560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 531/1048] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 08:13:31.442131 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-74153d57-6f13-46e6-9dbd-8fd64b389660 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:31.442738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-74153d57-6f13-46e6-9dbd-8fd64b389660 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:31.493389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-74153d57-6f13-46e6-9dbd-8fd64b389660 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:31.500172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-74153d57-6f13-46e6-9dbd-8fd64b389660 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1215 microversion: 2.1 time: 0.061801 Aug 01 08:13:31.500734 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 518/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:31 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1215 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:31.688894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:31.689568 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:31.695888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:31.696454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:31.697319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:31.697756 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:31.830242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:31.838019 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b9f5e058-d2a7-4e34-b639-889633bc7e5d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.153677 Aug 01 08:13:31.838604 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 532/1050] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:31 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:32.005009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:32.005566 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:32.012260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.012704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.013455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.013881 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.069506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c32a513f-3408-46fe-b62a-f5d5dd923ec5", "device": "/dev/sdb"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:32.072604 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:32.078753 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.079208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.080033 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.080477 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.146777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:32.156238 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:32.157864 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:32.159083 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bfb67e5c-afe4-4b5a-8cad-daf902b9c126 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.157992 Aug 01 08:13:32.159798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 519/1051] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:31 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:13:32.324132 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:32.324685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:32.330593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.331032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.331823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.332253 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.466066 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:32.473851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9f1e95cf-67d6-4a50-a6ce-8570dcb2805a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.153785 Aug 01 08:13:32.474442 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 520/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:32 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:32.520543 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ef108082-eb95-4ee2-ad38-d1649a6b2119 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:32.521147 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ef108082-eb95-4ee2-ad38-d1649a6b2119 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:32.572222 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ef108082-eb95-4ee2-ad38-d1649a6b2119 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:32.578774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ef108082-eb95-4ee2-ad38-d1649a6b2119 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1215 microversion: 2.1 time: 0.061876 Aug 01 08:13:32.579254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 521/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:32 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1215 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:32.860670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:32.860670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:32.866642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.867078 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.868058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:32.868995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:32.997886 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:33.005320 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ae89edf7-8a2a-4585-ae2a-b7086bce79e0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.149196 Aug 01 08:13:33.005879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 522/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:32 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:33.183107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:33.183686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:33.190143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:33.190578 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:33.191323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:33.191844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:33.323252 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:33.331031 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:33.332526 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:33.333678 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-069df4a8-0688-4470-9143-ca7a43e89f54 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.154547 Aug 01 08:13:33.334224 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 523/1055] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:33 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:13:33.495019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:33.495575 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:33.501434 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:33.501885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:33.502642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:33.503080 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:33.636538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:33.643661 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f7809e5f-bd81-4376-a233-122fab0cff82 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1577 microversion: 2.1 time: 0.152495 Aug 01 08:13:33.644282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 524/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:33 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:33.648607 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0a313e3b-dcc8-452f-a66a-05f5c4dfd0dd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:33.649223 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0a313e3b-dcc8-452f-a66a-05f5c4dfd0dd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:33.703178 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0a313e3b-dcc8-452f-a66a-05f5c4dfd0dd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:33.709914 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0a313e3b-dcc8-452f-a66a-05f5c4dfd0dd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1215 microversion: 2.1 time: 0.064695 Aug 01 08:13:33.710468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 525/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:33 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:34.041275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:34.041275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:34.041275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.041275 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.042956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.042956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.401650 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:34.409513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f27271ad-ebfb-459a-bece-6fd299168722 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.385854 Aug 01 08:13:34.410073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 526/1058] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:34 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:34.414853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:34.415700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:34.422157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.422606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.423450 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.423932 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.432360 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-67ada8e5-73b0-4b34-bb73-3d9137846cc8 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "POST /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.366737 Aug 01 08:13:34.433577 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 533/1059] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:13:32 2022] POST /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544/os-volume_attachments => generated 194 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:13:34.565382 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:34.573828 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:34.575383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:34.576858 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b9da4ef4-d281-4a96-830d-3e77f8e3aedf tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1722 microversion: 2.20 time: 0.165709 Aug 01 08:13:34.577619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 527/1060] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:34 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 08:13:34.668424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:34.669399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:34.676071 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.676525 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.677337 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.677880 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.682569 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:34.734006 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e9a6fa12-4ffb-45be-b7b0-cc9e1cdbe2fd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:34.734945 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e9a6fa12-4ffb-45be-b7b0-cc9e1cdbe2fd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:34.798257 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e9a6fa12-4ffb-45be-b7b0-cc9e1cdbe2fd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:34.805118 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e9a6fa12-4ffb-45be-b7b0-cc9e1cdbe2fd tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1215 microversion: 2.1 time: 0.075051 Aug 01 08:13:34.806087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 528/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:34 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:34.822226 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:34.832864 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a5c9517d-b120-495c-9065-83b8d7eb44cd tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1391 microversion: 2.1 time: 0.168826 Aug 01 08:13:34.832864 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 534/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:34 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:34.863336 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-ba966132-4606-42c7-b7b2-e7665aa63274 req-9eeb808d-dcb0-4ac8-ae00-4babe93f5747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4275be3a-588c-41c0-bd18-f69e64f815cd", "name": "network-vif-deleted", "tag": "48952e63-8d30-418d-8121-3c0db27a11ef"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:34.874614 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-ba966132-4606-42c7-b7b2-e7665aa63274 req-9eeb808d-dcb0-4ac8-ae00-4babe93f5747 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:34.875063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-ba966132-4606-42c7-b7b2-e7665aa63274 req-9eeb808d-dcb0-4ac8-ae00-4babe93f5747 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:34.885545 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-ba966132-4606-42c7-b7b2-e7665aa63274 req-9eeb808d-dcb0-4ac8-ae00-4babe93f5747 service nova] Creating event network-vif-deleted:48952e63-8d30-418d-8121-3c0db27a11ef for instance 4275be3a-588c-41c0-bd18-f69e64f815cd on hv-cinder-74014 Aug 01 08:13:34.891074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-ba966132-4606-42c7-b7b2-e7665aa63274 req-9eeb808d-dcb0-4ac8-ae00-4babe93f5747 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031667 Aug 01 08:13:34.895373 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 529/1063] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:35.434994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:35.436267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:35.447955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.448415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.449199 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.449710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.607823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:35.609468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:35.616485 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.616930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.617700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.618187 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.629453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:35.638592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5fa62ba1-56de-4d63-bf45-a3be7a60770c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.208124 Aug 01 08:13:35.639178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 535/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:35 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:35.687867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:35.698042 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:35.699633 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:35.701313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-903a1186-24a0-4acf-a366-a13f1294f2ab tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1654 microversion: 2.20 time: 0.103623 Aug 01 08:13:35.702617 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 530/1065] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:35 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1654 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:13:35.826797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:35.827513 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:35.833626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.834066 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.834860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.835298 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.853928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:35.854669 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:35.861073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.861524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.862488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.862930 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.898169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:35.898913 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:35.899996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lazy-loading 'fault' on Instance uuid 4275be3a-588c-41c0-bd18-f69e64f815cd {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:35.918244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:35.925981 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7ccf219c-381f-4a6b-8ebf-3921a5c524c6 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1219 microversion: 2.1 time: 0.103009 Aug 01 08:13:35.926561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 536/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:35 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:35.952203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:35.960037 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-63886494-fb4c-4cd8-89d2-28b5c38b8fee tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 200 len: 1230 microversion: 2.1 time: 0.110541 Aug 01 08:13:35.960630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 531/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:35 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:36.660708 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:36.661503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:36.668472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.669191 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.669977 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.670422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.725916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:36.726723 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:36.734890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.735366 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.736193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.737310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.774887 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.775383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.775906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lazy-loading 'fault' on Instance uuid 0301e609-db16-49d6-8655-2f8033dbadaf {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:36.824486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:36.833873 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:36.835776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e5f1b4073742b4b9bd8a48cce38341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3129476636bb43e9a14ef674c4720233', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:36.836979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-77f9a978-ab28-4292-97c5-3425aad35cc6 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 200 len: 1371 microversion: 2.20 time: 0.115102 Aug 01 08:13:36.838119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 532/1068] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:36 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 1371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 08:13:36.846787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:36.855992 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-443cec12-5d6d-4794-8fcf-dbb77c7c0089 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.199025 Aug 01 08:13:36.856703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 537/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:36 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:36.912958 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-d1fb8361-561c-4945-8d27-4eaf882e6e97 req-0d4e620a-2449-43c7-a8e3-5822f7ab8ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0301e609-db16-49d6-8655-2f8033dbadaf", "name": "network-vif-deleted", "tag": "e9254c41-aa3b-44bb-acda-eff5bfc51cda"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:36.923630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-d1fb8361-561c-4945-8d27-4eaf882e6e97 req-0d4e620a-2449-43c7-a8e3-5822f7ab8ff9 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.924109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-d1fb8361-561c-4945-8d27-4eaf882e6e97 req-0d4e620a-2449-43c7-a8e3-5822f7ab8ff9 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.937259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-d1fb8361-561c-4945-8d27-4eaf882e6e97 req-0d4e620a-2449-43c7-a8e3-5822f7ab8ff9 service nova] Creating event network-vif-deleted:e9254c41-aa3b-44bb-acda-eff5bfc51cda for instance 0301e609-db16-49d6-8655-2f8033dbadaf on hv-cinder-74014 Aug 01 08:13:36.942849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-d1fb8361-561c-4945-8d27-4eaf882e6e97 req-0d4e620a-2449-43c7-a8e3-5822f7ab8ff9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033264 Aug 01 08:13:36.943462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 533/1070] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:36.948324 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:36.949923 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:36.957048 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.957571 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.958544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.959154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.982575 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:36.983268 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: 4275be3a-588c-41c0-bd18-f69e64f815cd] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:36.989849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.990295 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:36.991219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:36.991700 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:37.006228 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] HTTP exception thrown: Instance 4275be3a-588c-41c0-bd18-f69e64f815cd could not be found. Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Request method failure captured: Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd HTTP/1.1 Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54ineqrYuyD7yb8UESEVVpEg3zcnJg3W2c2BQkl7IzRsZGdIMJZl4VrLv-Vw8w71XJTTOTPzOY3n3zUDypIgwagOvIEzZ7z42Sig_nPsF5x-F0z9bC1FUBrVjrkFIYfrSjBhIMrnRNutt70-5Z0zoqXhbahtP61Qt5ZERdYG1wRLsTU Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:13:37.007953 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03212885780843bf830a8f030756db97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03212885780843bf830a8f030756db97", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: d4d85df24c9e4312bbe2da197f55e116 Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 4275be3a-588c-41c0-bd18-f69e64f815cd could not be found. Aug 01 08:13:37.010050 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '4275be3a-588c-41c0-bd18-f69e64f815cd'} Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4275be3a-588c-41c0-bd18-f69e64f815cd could not be found. Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:37.011128 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4275be3a-588c-41c0-bd18-f69e64f815cd could not be found. Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4275be3a-588c-41c0-bd18-f69e64f815cd could not be found. Aug 01 08:13:37.012755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.014193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Returning 404 to user: Instance 4275be3a-588c-41c0-bd18-f69e64f815cd could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:37.014193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3511622e-c541-4929-8a31-75ef3c9334ce tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd" status: 404 len: 111 microversion: 2.1 time: 0.032046 Aug 01 08:13:37.014193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 534/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:36 2022] GET /compute/v2.1/servers/4275be3a-588c-41c0-bd18-f69e64f815cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 08:13:37.031339 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:37.039235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9532f5c2-cf95-44ee-ba67-817cc6291e10 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1219 microversion: 2.1 time: 0.096828 Aug 01 08:13:37.040622 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 538/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:36 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:37.862387 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:37.862999 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:37.869594 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:37.870149 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:37.870987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:37.871424 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:37.878192 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:37.878738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:37.885350 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:37.885512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] HTTP exception thrown: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:37.888375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:37.888375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:37.888375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Request method failure captured: Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf HTTP/1.1 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54iDIdtR2YLs41AuU_BM2BDCEOJ-LPVUWh8hvpahCjM_EtEY4T7KK1oW50h1zLyxtDwOvPn0Mn-kAHZyP5ql7noI0WLgNQdXZ4-_VliMCjDmtq2QatgHLj50FTURfq8N1KX4AyMN0W8LDOt6xWLrCjReogsIuUgkcgfnUmXrs0xGscc Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:13:37.888702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3129476636bb43e9a14ef674c4720233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3129476636bb43e9a14ef674c4720233", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 14e5f1b4073742b4b9bd8a48cce38341 Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:37.894123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '0301e609-db16-49d6-8655-2f8033dbadaf'} Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:37.895174 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:37.896797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:37.898322 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Returning 404 to user: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:37.898322 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8d90481a-a3f0-4c03-ad5f-4f902bfb427c tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 404 len: 111 microversion: 2.20 time: 0.030745 Aug 01 08:13:37.898322 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 535/1073] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:37 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:13:37.900602 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-59e20125-5810-44d9-b4ca-86ab8cfb6d9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '.version_select at 0x7efe47cf7c10>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:38.002065 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-59e20125-5810-44d9-b4ca-86ab8cfb6d9a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-392782453" status: 204 len: 0 microversion: 2.20 time: 0.106360 Aug 01 08:13:38.003396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 536/1074] 10.222.0.48 () {60 vars in 1259 bytes} [Mon Aug 1 08:13:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-392782453 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 08:13:38.060882 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:38.061737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:38.072194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:38.072415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:38.073110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:38.074248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:38.094590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:38.103231 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-b0a9d54a-7fbf-4c60-8d34-5176812b5c55 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.228972 Aug 01 08:13:38.110951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 539/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:37 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:38.152903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:38.160494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e84cd716-2345-45e8-af32-2762a6ca44b1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1273 microversion: 2.1 time: 0.104307 Aug 01 08:13:38.161422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 537/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:38 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:39.132756 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:39.133422 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:39.140618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:39.141065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:39.141829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:39.142258 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:39.196779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:39.207063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:39.219737 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:39.220306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:39.221445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:39.221987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:39.314501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:39.324714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-05744295-0049-40e9-b2ee-06311287ffef tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.194971 Aug 01 08:13:39.325396 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 540/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:39 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:39.397074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:39.400963 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:39.406310 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a0fa127a-87c9-4ffe-a292-6c3e061accc3 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.225116 Aug 01 08:13:39.419954 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 538/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:39 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:40.085999 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-5f155b0b-96f5-4826-a816-7e5ac4ce6ca3 req-f0a1a58e-de26-4af4-b026-d22e03382ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374e07b1-c311-4137-a353-cf03f78d8f55", "tag": "771e33e8-e43d-4a46-9d88-f765bed9cfa7"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:40.095953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5f155b0b-96f5-4826-a816-7e5ac4ce6ca3 req-f0a1a58e-de26-4af4-b026-d22e03382ea5 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.101809 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5f155b0b-96f5-4826-a816-7e5ac4ce6ca3 req-f0a1a58e-de26-4af4-b026-d22e03382ea5 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.109786 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-5f155b0b-96f5-4826-a816-7e5ac4ce6ca3 req-f0a1a58e-de26-4af4-b026-d22e03382ea5 service nova] Creating event network-changed:771e33e8-e43d-4a46-9d88-f765bed9cfa7 for instance 374e07b1-c311-4137-a353-cf03f78d8f55 on hv-cinder-74014 Aug 01 08:13:40.115000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-5f155b0b-96f5-4826-a816-7e5ac4ce6ca3 req-f0a1a58e-de26-4af4-b026-d22e03382ea5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032531 Aug 01 08:13:40.116302 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 541/1079] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:40.162422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:40.165154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:40.173188 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.173643 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.174586 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.175477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.191627 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] HTTP exception thrown: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Request method failure captured: Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf HTTP/1.1 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54iDIdtR2YLs41AuU_BM2BDCEOJ-LPVUWh8hvpahCjM_EtEY4T7KK1oW50h1zLyxtDwOvPn0Mn-kAHZyP5ql7noI0WLgNQdXZ4-_VliMCjDmtq2QatgHLj50FTURfq8N1KX4AyMN0W8LDOt6xWLrCjReogsIuUgkcgfnUmXrs0xGscc Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:13:40.193448 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3129476636bb43e9a14ef674c4720233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3129476636bb43e9a14ef674c4720233", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 14e5f1b4073742b4b9bd8a48cce38341 Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.194994 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '0301e609-db16-49d6-8655-2f8033dbadaf'} Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:40.202412 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.203773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.205041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Returning 404 to user: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:40.205041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-91968d9e-f7f7-4a6d-92b9-0692f80937f2 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 404 len: 111 microversion: 2.20 time: 0.036827 Aug 01 08:13:40.205041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 539/1080] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 08:13:40 2022] DELETE /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:13:40.205270 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:40.205633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 0301e609-db16-49d6-8655-2f8033dbadaf] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:40.212000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.212579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.213369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.213812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.228692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] HTTP exception thrown: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Request method failure captured: Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf HTTP/1.1 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54iDIdtR2YLs41AuU_BM2BDCEOJ-LPVUWh8hvpahCjM_EtEY4T7KK1oW50h1zLyxtDwOvPn0Mn-kAHZyP5ql7noI0WLgNQdXZ4-_VliMCjDmtq2QatgHLj50FTURfq8N1KX4AyMN0W8LDOt6xWLrCjReogsIuUgkcgfnUmXrs0xGscc Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:13:40.231098 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3129476636bb43e9a14ef674c4720233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3129476636bb43e9a14ef674c4720233", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 14e5f1b4073742b4b9bd8a48cce38341 Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.234143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '0301e609-db16-49d6-8655-2f8033dbadaf'} Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:40.235612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. Aug 01 08:13:40.237597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:40.239037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Returning 404 to user: Instance 0301e609-db16-49d6-8655-2f8033dbadaf could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:40.239037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2ecf98cd-4aaf-4e70-a080-84abce60c12a tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf" status: 404 len: 111 microversion: 2.20 time: 0.032171 Aug 01 08:13:40.239037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 542/1081] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:40 2022] GET /compute/v2.1/servers/0301e609-db16-49d6-8655-2f8033dbadaf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:13:40.349591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:40.350745 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:40.354675 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:40.359240 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.359947 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.361276 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.361812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.427179 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:40.428213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:40.435837 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.436291 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.437061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.437496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.581797 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:40.590597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d16240a6-f859-4faa-84b4-7b5e8ee1cb60 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.247089 Aug 01 08:13:40.591803 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 540/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:40 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:40.596670 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:40.597161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:40.604568 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.605849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.606901 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.607380 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.636817 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:13:40.692594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:40.700815 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-60c35664-6bc0-4a3a-8f9f-b92aa560e87c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.277424 Aug 01 08:13:40.701389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 543/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:40 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:40.850686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-5dcb60e5-05a6-4328-a174-eebc31ebd72c req-d13a577f-fe30-4937-a25d-1feb4cfc7b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ede14461-4e85-4d6e-b992-91841e96a6fe", "tag": "5e3352b1-549a-4492-b0c7-a28d961cc520"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:40.865556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5dcb60e5-05a6-4328-a174-eebc31ebd72c req-d13a577f-fe30-4937-a25d-1feb4cfc7b13 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.865556 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-5dcb60e5-05a6-4328-a174-eebc31ebd72c req-d13a577f-fe30-4937-a25d-1feb4cfc7b13 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.893921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-5dcb60e5-05a6-4328-a174-eebc31ebd72c req-d13a577f-fe30-4937-a25d-1feb4cfc7b13 service nova] Creating event network-changed:5e3352b1-549a-4492-b0c7-a28d961cc520 for instance ede14461-4e85-4d6e-b992-91841e96a6fe on hv-cinder-74014 Aug 01 08:13:40.893921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-5dcb60e5-05a6-4328-a174-eebc31ebd72c req-d13a577f-fe30-4937-a25d-1feb4cfc7b13 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180957 Aug 01 08:13:40.893921 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 544/1084] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:40.914456 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dcb5b6c4-9d7e-4bcf-a57f-a41f29894792 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 204 len: 0 microversion: 2.1 time: 0.321254 Aug 01 08:13:40.915272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 541/1085] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:13:40 2022] DELETE /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:13:40.924060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:40.928200 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:40.930975 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.931428 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:40.932206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:40.932642 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.073198 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:41.081612 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-54b24c58-c071-482a-8bbb-a7e0eac40843 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1579 microversion: 2.1 time: 0.161710 Aug 01 08:13:41.082186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 545/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:40 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:41.580391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:41.580987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:41.587565 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.588008 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.588773 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.589845 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.603274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] HTTP exception thrown: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Request method failure captured: Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d HTTP/1.1 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54iDIdtR2YLs41AuU_BM2BDCEOJ-LPVUWh8hvpahCjM_EtEY4T7KK1oW50h1zLyxtDwOvPn0Mn-kAHZyP5ql7noI0WLgNQdXZ4-_VliMCjDmtq2QatgHLj50FTURfq8N1KX4AyMN0W8LDOt6xWLrCjReogsIuUgkcgfnUmXrs0xGscc Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:13:41.605172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3129476636bb43e9a14ef674c4720233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3129476636bb43e9a14ef674c4720233", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 14e5f1b4073742b4b9bd8a48cce38341 Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.607044 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '113f63fa-4474-43ba-bbaa-75beddceb74d'} Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:41.608181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.609938 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.611885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Returning 404 to user: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:41.611885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-85d638fc-fae4-41b7-9434-6389ff7d3631 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 404 len: 111 microversion: 2.20 time: 0.030508 Aug 01 08:13:41.611885 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 542/1087] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 08:13:41 2022] DELETE /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 08:13:41.615674 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:41.616278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] [instance: 113f63fa-4474-43ba-bbaa-75beddceb74d] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:41.617229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:41.617927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:41.620650 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:41.621617 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:41.622290 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.622727 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.623486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.623961 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.627079 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.627551 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.628344 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.628783 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.638610 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] HTTP exception thrown: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Request method failure captured: Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d HTTP/1.1 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54iDIdtR2YLs41AuU_BM2BDCEOJ-LPVUWh8hvpahCjM_EtEY4T7KK1oW50h1zLyxtDwOvPn0Mn-kAHZyP5ql7noI0WLgNQdXZ4-_VliMCjDmtq2QatgHLj50FTURfq8N1KX4AyMN0W8LDOt6xWLrCjReogsIuUgkcgfnUmXrs0xGscc Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:13:41.640381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3129476636bb43e9a14ef674c4720233"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3129476636bb43e9a14ef674c4720233", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3129476636bb43e9a14ef674c4720233"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 3129476636bb43e9a14ef674c4720233 Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-478351880 Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 14e5f1b4073742b4b9bd8a48cce38341 Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-478351880-project Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.642186 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '113f63fa-4474-43ba-bbaa-75beddceb74d'} Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:41.643048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. Aug 01 08:13:41.644641 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:41.645822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] Returning 404 to user: Instance 113f63fa-4474-43ba-bbaa-75beddceb74d could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:41.645822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-be8cfbae-5a32-44dc-8549-a3c26b709911 tempest-AttachVolumeShelveTestJSON-478351880 tempest-AttachVolumeShelveTestJSON-478351880-project] 10.222.0.48 "GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d" status: 404 len: 111 microversion: 2.20 time: 0.029625 Aug 01 08:13:41.645822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 543/1088] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 08:13:41 2022] GET /compute/v2.1/servers/113f63fa-4474-43ba-bbaa-75beddceb74d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 08:13:41.721767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:41.722383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:41.729312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.730137 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.731119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:41.732022 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:41.787400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:41.797399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2d087139-e6f4-4336-88b4-deedcd9ffe48 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.184785 Aug 01 08:13:41.798359 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 546/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:41 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:41.952378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:41.959950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cfdba841-6452-4990-af18-778fb29223d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.242151 Aug 01 08:13:41.960630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 544/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:41 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:42.103169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:42.103737 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:42.110805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:42.111265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:42.112114 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:42.112560 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:42.252075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:42.259793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-608eb5b0-e2ca-4966-a0cf-41944415279a tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1579 microversion: 2.1 time: 0.160728 Aug 01 08:13:42.260369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 547/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:42 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:42.820977 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:42.822249 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:42.829242 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:42.829992 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:42.830992 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:42.831708 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:42.981768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:42.982496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:42.989499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:42.990015 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:42.990846 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:42.991369 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:43.072493 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:43.081815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a4b1cc84-e7e4-4dcb-909f-9c764f3a998d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.264199 Aug 01 08:13:43.081815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 545/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:42 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:43.143067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:43.151007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4de8acbb-5639-4d82-a1c7-bd5ea2be93cf tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.173746 Aug 01 08:13:43.158883 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 548/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:42 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:43.282599 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:43.283118 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:43.289338 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:43.289787 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:43.290561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:43.291001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:43.571116 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:43.579755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f68752f6-ab3d-41fb-b7f9-ac4d73ef5df8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1579 microversion: 2.1 time: 0.301117 Aug 01 08:13:43.584611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 546/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:43 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1579 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:44.108290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:44.111692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:44.117214 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:44.117722 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:44.118509 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:44.118951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:44.172455 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:44.173069 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:44.179244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:44.193814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:44.194653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:44.195141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:44.287487 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:44.296115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4837aecb-7ea6-400b-975b-da4f630ae3e4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.195028 Aug 01 08:13:44.297851 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 549/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:44 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:44.416603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:44.425136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bc83192e-1a9e-4583-86d9-d49f0aeba076 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.256686 Aug 01 08:13:44.425787 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 547/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:44 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:44.600559 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:44.601081 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:44.607751 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:44.608241 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:44.609008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:44.609453 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:45.083690 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:45.099244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d862ebf1-4fe3-4476-aa65-dd72bc22e609 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1579 microversion: 2.1 time: 0.498955 Aug 01 08:13:45.112237 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 550/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:44 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1579 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:45.324872 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:45.325557 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:45.329327 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=8 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:45.342115 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:45.342572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:45.345469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:45.345913 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:45.452486 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:45.453734 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:45.461954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:45.462858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:45.464529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:45.465315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:45.601106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:45.611422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-242b5548-63f8-4eb1-8836-60554d0bd31e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.296788 Aug 01 08:13:45.616011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 548/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:45 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:45.880244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:45.893232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-22b8fc6a-3384-41cd-8dd3-0b3ea1ab3c68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.450547 Aug 01 08:13:45.894393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 551/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:45 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:46.127597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:46.128278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:46.144629 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.153623 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.153623 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.153623 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.234579 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:46.244825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a2707650-ccec-4267-b0ad-33dd73d89240 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1392 microversion: 2.1 time: 0.121814 Aug 01 08:13:46.247701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 549/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:46 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1392 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:46.281083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-14954e16-2f48-48ee-b506-71389359f1d1 req-e31bf4d0-af10-4c13-b400-ae537112615b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ede14461-4e85-4d6e-b992-91841e96a6fe", "name": "network-vif-deleted", "tag": "5e3352b1-549a-4492-b0c7-a28d961cc520"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:46.290767 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-14954e16-2f48-48ee-b506-71389359f1d1 req-e31bf4d0-af10-4c13-b400-ae537112615b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.291216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-14954e16-2f48-48ee-b506-71389359f1d1 req-e31bf4d0-af10-4c13-b400-ae537112615b service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.302635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-14954e16-2f48-48ee-b506-71389359f1d1 req-e31bf4d0-af10-4c13-b400-ae537112615b service nova] Creating event network-vif-deleted:5e3352b1-549a-4492-b0c7-a28d961cc520 for instance ede14461-4e85-4d6e-b992-91841e96a6fe on hv-cinder-74014 Aug 01 08:13:46.307467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-14954e16-2f48-48ee-b506-71389359f1d1 req-e31bf4d0-af10-4c13-b400-ae537112615b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030130 Aug 01 08:13:46.309055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 552/1101] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:46.634204 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:46.634821 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:46.650534 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.651005 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.652393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.652891 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.853088 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:46.863381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dbd62a02-6adb-4b05-a73e-ff04d54093cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.231933 Aug 01 08:13:46.868692 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 550/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:46 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:46.916128 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:46.916740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:46.923937 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.924392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.925160 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:46.925599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:46.945641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:47.069679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:47.078026 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-957fb938-4862-4270-80aa-745dfa90ed90 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.166559 Aug 01 08:13:47.078654 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 553/1103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:46 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:47.266974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:47.267591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:47.273860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:47.274314 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:47.275077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:47.275566 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:47.338425 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:47.346337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ca2316e7-ce1b-4fe4-b4a0-1d0ddf27501d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1392 microversion: 2.1 time: 0.083151 Aug 01 08:13:47.346905 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 551/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:47 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1392 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:47.886432 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:47.887253 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:47.893748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:47.894580 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:47.895636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:47.896066 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:47.900283 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-46bebe42-cc2b-49a3-be8b-fb480a680bd2 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Action: 'create', calling method: .version_select at 0x7efe3f5a51f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1125859788"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:48.036219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:48.044585 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-798fb0d9-5de3-405a-86b7-10bc2c133885 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.162624 Aug 01 08:13:48.045153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 552/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:47 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:48.098022 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:48.098639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:48.105232 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:48.105683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:48.106487 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:48.106924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:48.240813 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:48.249494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-57e301ee-e06d-4c59-b8ee-1b3233474436 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.155208 Aug 01 08:13:48.254472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 553/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:48 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:48.367256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:48.367892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:48.374680 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:48.375119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:48.375904 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:48.376339 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:48.439114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:48.446724 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ec8c6677-075a-4670-a7df-278d81ff8044 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1392 microversion: 2.1 time: 0.083430 Aug 01 08:13:48.447285 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 554/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:48 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1392 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:48.577824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-46bebe42-cc2b-49a3-be8b-fb480a680bd2 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.795427 Aug 01 08:13:48.578455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 554/1108] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Aug 1 08:13:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 797 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 08:13:48.591607 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-41625bd9-6114-4f18-9339-dc0d20534fc5 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf7040>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:48.639430 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-41625bd9-6114-4f18-9339-dc0d20534fc5 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 200 len: 345 microversion: 2.1 time: 0.052252 Aug 01 08:13:48.640049 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 555/1109] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:13:48 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:49.066839 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:49.067484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:49.074828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:49.075282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:49.076075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:49.076521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:49.210893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:49.219113 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2bd7c437-3af6-43c7-93f7-82c87a2541ad tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.156581 Aug 01 08:13:49.220640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 555/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:49 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:49.270429 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:49.271333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:49.278229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:49.278665 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:49.279407 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:49.279867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:49.408799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:49.412125 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:49.416373 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a4ee4058-b85a-45c9-ad50-acdfeb370bf7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.150233 Aug 01 08:13:49.420655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 556/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:49 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:49.467792 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:49.468347 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:49.474503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:49.474958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:49.475768 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:49.476206 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:49.536040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:49.544433 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e5bfb92a-eff0-4dda-b4d1-94a580e7773b tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1392 microversion: 2.1 time: 0.081173 Aug 01 08:13:49.545007 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 556/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:49 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1392 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:49.654250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-28ca4ab6-cca8-4670-8631-4e898a08a64d tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cd0280>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:49.699894 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-28ca4ab6-cca8-4670-8631-4e898a08a64d tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 200 len: 345 microversion: 2.1 time: 0.050597 Aug 01 08:13:49.700459 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 557/1113] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:13:49 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:50.241651 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:50.242267 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:50.249256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:50.249706 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:50.250464 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:50.250900 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:50.387370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:50.395150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-269aa5cf-1fc5-4424-b503-d1132b357e5c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.157424 Aug 01 08:13:50.395748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 557/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:50 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:50.441170 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:50.441799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:50.447853 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:50.449012 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:50.449893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:50.450321 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:50.564736 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:50.565382 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:50.567218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:50.572641 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:50.573091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:50.574375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:50.574919 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:50.579036 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:50.587767 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e6ca00dc-1cd2-4fae-b4df-55cec2dc7adc tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.151770 Aug 01 08:13:50.588452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 558/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:50 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:50.640466 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:50.648627 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-18609f29-cef0-41ce-baf9-7eab0dca2344 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1226 microversion: 2.1 time: 0.087919 Aug 01 08:13:50.649186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 558/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:50 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:50.721229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-943e2c4d-8a57-45fb-9395-15190a7ea5fd tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f54e820>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:50.769248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-943e2c4d-8a57-45fb-9395-15190a7ea5fd tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 200 len: 345 microversion: 2.1 time: 0.052397 Aug 01 08:13:50.769806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 559/1117] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:13:50 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:13:51.416390 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:51.417664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:51.425636 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.426195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.427006 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.427442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.534282 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-4f41b205-6965-4421-9251-13e43fd063f4 req-b4391661-4848-4395-b5be-1b6c5b6c9aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e07b1-c311-4137-a353-cf03f78d8f55", "name": "network-vif-plugged", "status": "completed", "tag": "771e33e8-e43d-4a46-9d88-f765bed9cfa7"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:51.554564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4f41b205-6965-4421-9251-13e43fd063f4 req-b4391661-4848-4395-b5be-1b6c5b6c9aa3 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.555303 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-4f41b205-6965-4421-9251-13e43fd063f4 req-b4391661-4848-4395-b5be-1b6c5b6c9aa3 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.566712 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-4f41b205-6965-4421-9251-13e43fd063f4 req-b4391661-4848-4395-b5be-1b6c5b6c9aa3 service nova] Creating event network-vif-plugged:771e33e8-e43d-4a46-9d88-f765bed9cfa7 for instance 374e07b1-c311-4137-a353-cf03f78d8f55 on hv-cinder-74014 Aug 01 08:13:51.572334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-4f41b205-6965-4421-9251-13e43fd063f4 req-b4391661-4848-4395-b5be-1b6c5b6c9aa3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042310 Aug 01 08:13:51.573756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 560/1118] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:13:51.593746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:51.602406 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8afec79a-417e-4d23-bc61-0ee59677742d tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.189766 Aug 01 08:13:51.603345 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 559/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:51 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:51.610816 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:51.611929 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:51.618328 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.618844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.619734 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.620220 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.671407 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:51.672847 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:51.688223 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.688767 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.689570 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.690013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.739290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:51.740067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:51.740682 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lazy-loading 'fault' on Instance uuid ede14461-4e85-4d6e-b992-91841e96a6fe {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:51.785640 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:51.785787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:51.787435 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c1b59fde-3422-4b99-abff-522d6e18c551 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.181013 Aug 01 08:13:51.788547 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 561/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:51 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:51.794630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-24924ed0-b38f-4d31-ba4d-9f172f40eb2b tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf8280>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:51.798173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-61018434-aaa6-4634-92be-5fe80f7c66c8 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1231 microversion: 2.1 time: 0.132004 Aug 01 08:13:51.815759 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 560/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:51 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1231 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:51.845542 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-24924ed0-b38f-4d31-ba4d-9f172f40eb2b tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 200 len: 346 microversion: 2.1 time: 0.055803 Aug 01 08:13:51.846127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 562/1122] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:13:51 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:51.860335 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d3f7a590-cc93-4848-8809-1ae5477db062 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Action: 'create', calling method: .version_select at 0x7efe3f52b040>, body: {"snapshot": {"volume_id": "6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1991734147"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:52.265064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d3f7a590-cc93-4848-8809-1ae5477db062 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.410423 Aug 01 08:13:52.265711 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 561/1123] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Aug 1 08:13:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:52.281191 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cf574bd2-6487-4fb2-9592-765594e8e3f5 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cbaa60>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:52.311909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cf574bd2-6487-4fb2-9592-765594e8e3f5 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.039142 Aug 01 08:13:52.312469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 563/1124] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:52 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:52.323713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1d5579e1-47a5-46de-93a4-40398e880da9 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f5698b0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:52.355584 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1d5579e1-47a5-46de-93a4-40398e880da9 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036037 Aug 01 08:13:52.356149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 562/1125] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 1 08:13:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:13:52.367237 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fdcf15db-6b81-4d68-909c-0676b189c366 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47c78af0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:52.398770 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fdcf15db-6b81-4d68-909c-0676b189c366 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.035228 Aug 01 08:13:52.399360 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 564/1126] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:52 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:52.626700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:52.627360 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:52.634450 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.634947 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.635827 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.636257 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.765262 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:52.772685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dd388c40-5f08-49d7-9990-e1bd4a74aab6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1571 microversion: 2.1 time: 0.150337 Aug 01 08:13:52.773261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 563/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:52 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:52.794709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:52.795300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:52.801245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.801685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.802468 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.802898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.809599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:52.810454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:52.816407 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.816943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.817729 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.818174 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.831427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118232) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 08:13:52.948300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:52.956379 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9deae57e-4aab-4083-84bb-485595131d29 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.151231 Aug 01 08:13:52.956954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 564/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:52 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:52.961461 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:52.962099 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:52.968414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.968861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:52.969675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:52.970111 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:53.001993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:53.002449 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:53.002902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lazy-loading 'fault' on Instance uuid ede14461-4e85-4d6e-b992-91841e96a6fe {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:53.046930 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:53.054546 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-69fe3d6e-0951-4fb6-9e8b-c4739b709a8f tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1231 microversion: 2.1 time: 0.096448 Aug 01 08:13:53.055239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 565/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:52 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:53.070313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e3d99715-337a-4292-8f0c-3090d790e6b4 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "POST /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61/action" status: 202 len: 0 microversion: 2.1 time: 0.281289 Aug 01 08:13:53.071062 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 565/1130] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:13:52 2022] POST /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 08:13:53.079409 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:53.080152 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:53.086807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:53.086807 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:53.087485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:53.087960 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:53.221442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:53.231008 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fdf60215-567a-4f23-bfb2-d44a840aef3f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.155452 Aug 01 08:13:53.231828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 566/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:53 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:53.411316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-13ccc32d-d3a6-47c6-8ed7-37f6a49c287c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cd5f70>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:53.441156 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-13ccc32d-d3a6-47c6-8ed7-37f6a49c287c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.033584 Aug 01 08:13:53.441720 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 566/1132] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:53 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:53.977455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:53.978050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:53.984845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:53.985289 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:53.986062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:53.986535 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:54.076652 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:54.081166 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:54.085016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:54.085469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:54.086237 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:54.086669 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:54.117748 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:54.118194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:54.118636 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lazy-loading 'fault' on Instance uuid ede14461-4e85-4d6e-b992-91841e96a6fe {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:54.128879 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:54.136550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fdc0e071-effe-4e83-ae01-586eecc6321b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.162905 Aug 01 08:13:54.137271 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 567/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:53 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:54.159985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:54.167296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9434d41e-17bb-4381-9e0d-b2925a84e34e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1231 microversion: 2.1 time: 0.096452 Aug 01 08:13:54.167890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 567/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:54 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:54.253173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:54.253896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:54.259912 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:54.260368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:54.261135 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:54.261582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:54.396550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:54.404583 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c453ca2b-fed1-4408-acdd-3ce24f3c6d29 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.155400 Aug 01 08:13:54.409692 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 568/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:54 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:54.453685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3de67aed-adea-4672-9fd1-f08f87232214 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf7160>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:54.483790 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3de67aed-adea-4672-9fd1-f08f87232214 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.033798 Aug 01 08:13:54.484358 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 568/1136] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:54 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:55.158415 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:55.159028 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:55.165663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.166106 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.166859 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.167291 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.190055 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:55.190759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:55.196671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.197123 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.197878 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.198312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.231157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.231630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.232073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lazy-loading 'fault' on Instance uuid ede14461-4e85-4d6e-b992-91841e96a6fe {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:13:55.274452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d85df24c9e4312bbe2da197f55e116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03212885780843bf830a8f030756db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:55.282212 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8ea0a1f4-e196-4885-b98a-d6ab82393175 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 200 len: 1231 microversion: 2.1 time: 0.096422 Aug 01 08:13:55.282772 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 569/1137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:55 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:55.308232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:55.316177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-efb6c255-5be9-48b1-b6c2-f288bec7fe13 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.162037 Aug 01 08:13:55.316733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 569/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:55 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:55.428073 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:55.428951 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:55.436300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.436796 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.437833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.438372 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.497546 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7aff9239-19b4-457f-a0da-d5f22d1ddb60 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe4409fe50>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:55.532243 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7aff9239-19b4-457f-a0da-d5f22d1ddb60 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.039604 Aug 01 08:13:55.532820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 570/1139] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:55 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:55.537537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-8e1c00ac-49b1-4a78-8978-1a8eed8a8a85 req-9f75b6be-819f-4a46-8f19-19efef92ac54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "name": "network-vif-unplugged", "status": "completed", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:13:55.547989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-8e1c00ac-49b1-4a78-8978-1a8eed8a8a85 req-9f75b6be-819f-4a46-8f19-19efef92ac54 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:55.548440 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-8e1c00ac-49b1-4a78-8978-1a8eed8a8a85 req-9f75b6be-819f-4a46-8f19-19efef92ac54 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:55.560764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-8e1c00ac-49b1-4a78-8978-1a8eed8a8a85 req-9f75b6be-819f-4a46-8f19-19efef92ac54 service nova] Creating event network-vif-unplugged:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:13:55.566527 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-8e1c00ac-49b1-4a78-8978-1a8eed8a8a85 req-9f75b6be-819f-4a46-8f19-19efef92ac54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032519 Aug 01 08:13:55.567132 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 571/1140] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:55.588529 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:55.597159 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ad7bd713-1fa1-444a-a6d1-24c7bca302bd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.173032 Aug 01 08:13:55.597724 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 570/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:55 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:56.304174 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:56.304877 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: ede14461-4e85-4d6e-b992-91841e96a6fe] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:56.311755 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.312209 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.312966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.313403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.327247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] HTTP exception thrown: Instance ede14461-4e85-4d6e-b992-91841e96a6fe could not be found. Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Request method failure captured: Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe HTTP/1.1 Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54ineqrYuyD7yb8UESEVVpEg3zcnJg3W2c2BQkl7IzRsZGdIMJZl4VrLv-Vw8w71XJTTOTPzOY3n3zUDypIgwagOvIEzZ7z42Sig_nPsF5x-F0z9bC1FUBrVjrkFIYfrSjBhIMrnRNutt70-5Z0zoqXhbahtP61Qt5ZERdYG1wRLsTU Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:13:56.328812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03212885780843bf830a8f030756db97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03212885780843bf830a8f030756db97", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: d4d85df24c9e4312bbe2da197f55e116 Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance ede14461-4e85-4d6e-b992-91841e96a6fe could not be found. Aug 01 08:13:56.330499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': 'ede14461-4e85-4d6e-b992-91841e96a6fe'} Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede14461-4e85-4d6e-b992-91841e96a6fe could not be found. Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:56.331478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede14461-4e85-4d6e-b992-91841e96a6fe could not be found. Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede14461-4e85-4d6e-b992-91841e96a6fe could not be found. Aug 01 08:13:56.332916 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.334102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Returning 404 to user: Instance ede14461-4e85-4d6e-b992-91841e96a6fe could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:56.334102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-fb7b0de3-b0e8-455a-83a5-e5c825fa1ab7 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe" status: 404 len: 111 microversion: 2.1 time: 0.030757 Aug 01 08:13:56.334102 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 572/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:56 2022] GET /compute/v2.1/servers/ede14461-4e85-4d6e-b992-91841e96a6fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:13:56.339782 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:56.340511 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:56.347327 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.347810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.348579 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.349016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.545766 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8f4800f1-ffe6-496b-858b-a714ab02f1bf tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f569550>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:56.576976 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8f4800f1-ffe6-496b-858b-a714ab02f1bf tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.035845 Aug 01 08:13:56.577901 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 573/1143] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:56 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:13:56.583742 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:56.591943 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7c2648ef-7d4e-4a68-a38c-fc6ed045ae27 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.256441 Aug 01 08:13:56.592582 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 571/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:56 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:56.618050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:56.618662 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:56.625712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.626169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.626941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.627376 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.763320 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:56.770496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f0e0834e-7450-4706-9fcb-d75fa426f7e2 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.156281 Aug 01 08:13:56.771051 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 574/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:56 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:56.906298 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:56.906798 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:56.912984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.913445 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.914203 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.914639 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.928222 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] HTTP exception thrown: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Request method failure captured: Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce HTTP/1.1 Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54ineqrYuyD7yb8UESEVVpEg3zcnJg3W2c2BQkl7IzRsZGdIMJZl4VrLv-Vw8w71XJTTOTPzOY3n3zUDypIgwagOvIEzZ7z42Sig_nPsF5x-F0z9bC1FUBrVjrkFIYfrSjBhIMrnRNutt70-5Z0zoqXhbahtP61Qt5ZERdYG1wRLsTU Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:13:56.929852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03212885780843bf830a8f030756db97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03212885780843bf830a8f030756db97", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: d4d85df24c9e4312bbe2da197f55e116 Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.931498 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': 'afbbafe5-6682-410e-957c-38e6258e5dce'} Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:56.932346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.933608 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.935070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Returning 404 to user: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:56.935070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5f6a949f-1d60-4570-9acf-ad5cabcef74e tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "DELETE /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 404 len: 111 microversion: 2.1 time: 0.029443 Aug 01 08:13:56.935070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 572/1146] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:13:56 2022] DELETE /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:13:56.940402 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:56.941017 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] [instance: afbbafe5-6682-410e-957c-38e6258e5dce] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:56.946837 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.947286 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.948088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:56.948527 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:56.962001 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] HTTP exception thrown: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Request method failure captured: Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce HTTP/1.1 Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54ineqrYuyD7yb8UESEVVpEg3zcnJg3W2c2BQkl7IzRsZGdIMJZl4VrLv-Vw8w71XJTTOTPzOY3n3zUDypIgwagOvIEzZ7z42Sig_nPsF5x-F0z9bC1FUBrVjrkFIYfrSjBhIMrnRNutt70-5Z0zoqXhbahtP61Qt5ZERdYG1wRLsTU Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:13:56.963504 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/03212885780843bf830a8f030756db97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_03212885780843bf830a8f030756db97", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/03212885780843bf830a8f030756db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 03212885780843bf830a8f030756db97 Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-TestVolumeBootPattern-853309660 Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: d4d85df24c9e4312bbe2da197f55e116 Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-TestVolumeBootPattern-853309660-project Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.965705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': 'afbbafe5-6682-410e-957c-38e6258e5dce'} Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:13:56.966685 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. Aug 01 08:13:56.968157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:13:56.970004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Returning 404 to user: Instance afbbafe5-6682-410e-957c-38e6258e5dce could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:13:56.970004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-848fd328-56e1-4760-b7ee-e6d97b33332d tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce" status: 404 len: 111 microversion: 2.1 time: 0.028433 Aug 01 08:13:56.970004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 575/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:56 2022] GET /compute/v2.1/servers/afbbafe5-6682-410e-957c-38e6258e5dce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:13:57.589271 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c4f95f67-5995-4ced-a33a-6c33f53f57f2 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47c78700>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:57.612278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:57.613021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:57.619108 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c4f95f67-5995-4ced-a33a-6c33f53f57f2 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.033523 Aug 01 08:13:57.619371 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:57.619826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 573/1148] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:57 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:57.619930 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:57.620625 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:57.621062 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:57.640709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=100 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:13:57.750984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:57.758874 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e7d012d5-ace9-455a-b0ee-e921a5de7d99 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.150347 Aug 01 08:13:57.759443 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 576/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:57 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:13:57.792165 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:57.792776 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:57.799839 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:57.800283 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:57.801034 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:57.801465 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:57.929089 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:57.937143 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b411c405-fb7a-460a-92e6-a5bf5f8e7513 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.148765 Aug 01 08:13:57.937694 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 574/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:57 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:58.631862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ee7cdb01-9970-48a1-aa6e-4640e690a6ea tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f539160>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:58.662528 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ee7cdb01-9970-48a1-aa6e-4640e690a6ea tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.034418 Aug 01 08:13:58.663083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 577/1151] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:58 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:58.780591 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:58.781193 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:58.787806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:58.788256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:58.789011 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:58.789447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:58.919725 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:58.927074 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8b58cf91-5562-4431-8f92-c04ee4df31a5 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.150998 Aug 01 08:13:58.927657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 575/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:58 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:58.958054 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:58.958664 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:58.964746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:58.965196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:58.966103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:58.966539 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:59.097994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:13:59.105536 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4eaaa9a7-f0b5-4d39-8ba8-b19b65c5b7a5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.151264 Aug 01 08:13:59.106109 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 578/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:58 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:13:59.675598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-562f986e-bbee-456e-b3e6-6ef6bb137411 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf79d0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:59.704658 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-562f986e-bbee-456e-b3e6-6ef6bb137411 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.032829 Aug 01 08:13:59.705222 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 576/1154] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:13:59 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:13:59.948408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:13:59.948953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:13:59.955713 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:59.956168 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:13:59.956925 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:13:59.957389 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:00.087297 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:00.093117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6111fdcf-67ae-4470-8f6a-63c9f166d4d1 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.148645 Aug 01 08:14:00.093676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 579/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:13:59 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:00.126546 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:00.127155 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:00.133163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:00.133605 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:00.134385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:00.134814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:00.263145 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:00.270705 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0386b85f-a4fc-4b88-befe-91ab750ca439 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.148407 Aug 01 08:14:00.271260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 577/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:00 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:00.717287 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-43e9ab77-c986-458b-a840-7bcf2724cf53 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f6a1ca0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:00.745609 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-43e9ab77-c986-458b-a840-7bcf2724cf53 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.032140 Aug 01 08:14:00.746244 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 580/1157] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:00 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:01.113967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:01.117676 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:01.120907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:01.121358 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:01.122774 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:01.123419 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:01.254790 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:01.262555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-af0e531d-6ed7-4010-9894-ae5762f86e1d tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.152624 Aug 01 08:14:01.263330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 578/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:01 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:01.295842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:01.296463 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:01.302506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:01.302959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:01.303797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:01.304242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:01.681498 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:01.689314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-db6bc5e9-70cb-4215-9b65-fcecf3a3edd9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1579 microversion: 2.1 time: 0.398901 Aug 01 08:14:01.689942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 581/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:01 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1579 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:01.758171 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c70558c8-f4a9-40de-99da-c462670ef854 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe452b54c0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:01.788655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c70558c8-f4a9-40de-99da-c462670ef854 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.034232 Aug 01 08:14:01.789259 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 579/1160] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:01 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:02.283603 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:02.284291 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:02.290725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:02.291169 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:02.291974 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:02.292414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:02.425306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:02.432829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-63fba0ee-f1c0-48a8-ad10-520fa402a13b tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.153161 Aug 01 08:14:02.433394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 582/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:02 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:02.711601 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:02.712146 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:02.718623 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:02.719077 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:02.719872 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:02.720313 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:02.802012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7423a8df-210f-41a0-b91c-ccb876069183 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f5ae3a0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:02.831133 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7423a8df-210f-41a0-b91c-ccb876069183 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 288 microversion: 2.1 time: 0.032931 Aug 01 08:14:02.831732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 583/1162] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:02 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:14:02.843882 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-660c2bcd-c985-4150-8202-247e5da303af tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f52b310>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:02.852084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:02.860584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7ce6f76f-0227-4a3a-8e4e-3f8351d68433 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.153398 Aug 01 08:14:02.861151 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 580/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:02 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:02.954943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-660c2bcd-c985-4150-8202-247e5da303af tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 202 len: 0 microversion: 2.1 time: 0.115318 Aug 01 08:14:02.955501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 584/1164] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Aug 1 08:14:02 2022] DELETE /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 08:14:02.963710 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-82e37bb4-64e9-4119-8940-6baa48faafa2 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe452b51f0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:02.992110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-82e37bb4-64e9-4119-8940-6baa48faafa2 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.032177 Aug 01 08:14:02.992659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 581/1165] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:02 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:03.455332 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:03.455969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:03.462444 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:03.462887 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:03.463663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:03.464103 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:03.597000 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:03.604492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c017ad91-ba1c-4fc2-9e9a-eb0b6f7e9705 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.153491 Aug 01 08:14:03.605064 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 585/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:03 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:03.883278 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:03.883932 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:03.890479 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:03.890927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:03.891727 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:03.892205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:04.005311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1d0697fb-4971-44a6-9779-324c5ecb7802 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f5a5820>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:04.026756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:04.035398 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-55505ee5-8156-4f53-b59b-7caa165341f7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.156519 Aug 01 08:14:04.035698 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1d0697fb-4971-44a6-9779-324c5ecb7802 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.034183 Aug 01 08:14:04.036001 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 582/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:03 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:04.036271 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 586/1168] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:04 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:14:04.626116 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:04.626732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:04.632661 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:04.633114 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:04.633877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:04.634312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:04.763831 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:04.771256 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d15a9d40-109c-430e-9a44-23710fe4cd06 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.149794 Aug 01 08:14:04.771842 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 583/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:04 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:05.049125 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4964cefc-57f7-4625-8f20-115ba585e377 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f52b3a0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:05.057115 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:05.057513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:05.064756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:05.065210 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:05.065970 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:05.066588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:05.070678 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:05.079621 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4964cefc-57f7-4625-8f20-115ba585e377 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.034749 Aug 01 08:14:05.088196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 587/1170] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:05 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:05.195618 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:05.203827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-34b4f39b-8f2e-40fa-b05b-361d12794db5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.150816 Aug 01 08:14:05.204388 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:05 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:05.792511 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:05.793388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:05.800884 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:05.801322 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:05.802091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:05.802528 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:05.929073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:05.936544 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-dc44fafe-78d4-4a7d-bc71-47791298b703 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.147921 Aug 01 08:14:05.937104 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 588/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:05 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:06.098119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7f6d2e03-6028-48ec-b58e-6303163ca71b tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf8f70>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:06.127435 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7f6d2e03-6028-48ec-b58e-6303163ca71b tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.033086 Aug 01 08:14:06.128098 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 585/1173] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:06 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:06.224218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:06.224840 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:06.231353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:06.231830 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:06.232596 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:06.233040 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:06.360955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:06.368388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d79f2a61-b66c-48c0-b292-bd9e609c16f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.148033 Aug 01 08:14:06.368949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 589/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:06 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:06.956806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:06.957503 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:06.963512 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:06.963987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:06.964732 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:06.965173 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:07.096555 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:07.104169 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bfdcb313-a4dc-499a-b57d-19a4aae0e9a7 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1315 microversion: 2.1 time: 0.151275 Aug 01 08:14:07.104981 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 586/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:06 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:07.140014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-07e07601-763e-47e2-8a88-c516d5e1e603 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe3f5ae820>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:07.170545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-07e07601-763e-47e2-8a88-c516d5e1e603 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 200 len: 287 microversion: 2.1 time: 0.034364 Aug 01 08:14:07.171112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 590/1176] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:07 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:07.389059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:07.389667 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:07.396087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:07.396531 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:07.397306 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:07.397736 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:07.526857 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:07.535109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-612224a9-e11d-49a5-91fb-704c8dc20616 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.149942 Aug 01 08:14:07.535708 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 587/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:07 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:08.126520 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.127158 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:08.133917 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.134366 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.135131 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.135606 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.182209 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-63bb3401-dbeb-4e20-bb4b-f71e80f46595 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47c883a0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.208140 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-63bb3401-dbeb-4e20-bb4b-f71e80f46595 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] HTTP exception thrown: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-63bb3401-dbeb-4e20-bb4b-f71e80f46595 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Request method failure captured: Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c HTTP/1.1 Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54s77aWwFvjX_T9ln84r-RSPtliCmWPXhrw-_RgcH3-C2kF3DYnuILuJe8jPAqJEs4K-eH_9_RPa0AcruFzaSdAUeDiIumaY7ObmAMwsKPNapuB93aKG-FQ5PZp8oo06kUdnvYC9-3V8eh7djz9XzGCjeEJhe9BnAvkxSbQGtM9ETgk Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:14:08.210420 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e0d366348c8470d99ee0c1807fd6c3b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: a067a102409a425ea52cca26794f21c6 Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '93d58d9f-5c2f-4934-8210-46ef892bbb5c'} Aug 01 08:14:08.211909 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. (HTTP 404) (Request-ID: req-534547fb-d015-4aba-bc20-f8cbacd2ea53) Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.212933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:14:08.214299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 08:14:08.216462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-63bb3401-dbeb-4e20-bb4b-f71e80f46595 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Returning 404 to user: Snapshot 93d58d9f-5c2f-4934-8210-46ef892bbb5c could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:14:08.218087 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-63bb3401-dbeb-4e20-bb4b-f71e80f46595 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c" status: 404 len: 111 microversion: 2.1 time: 0.033508 Aug 01 08:14:08.219166 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 588/1178] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 08:14:08 2022] GET /compute/v2.1/os-snapshots/93d58d9f-5c2f-4934-8210-46ef892bbb5c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 08:14:08.220447 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4e634265-fdd8-416e-9857-a86140b3bef3 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf8430>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.274289 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:08.281985 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7c427064-93f6-4675-b8f1-27e6fc71470a tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1464 microversion: 2.1 time: 0.160365 Aug 01 08:14:08.282548 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 591/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:08 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:08.330817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.331331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:08.337709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.338164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.338989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.339710 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.367920 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:14:08.405482 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4e634265-fdd8-416e-9857-a86140b3bef3 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 202 len: 0 microversion: 2.1 time: 0.188313 Aug 01 08:14:08.405967 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 589/1180] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:14:08 2022] DELETE /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:14:08.414789 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2cdd114f-f958-4999-ad54-779998d1f105 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47c88b80>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.462344 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2cdd114f-f958-4999-ad54-779998d1f105 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 200 len: 345 microversion: 2.1 time: 0.051662 Aug 01 08:14:08.465343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 590/1181] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:14:08 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:14:08.557815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.558444 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:08.565346 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.565783 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.566534 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.566962 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.651495 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-7b04f20f-4827-4bea-86b2-4a53016d4687 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "DELETE /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 204 len: 0 microversion: 2.1 time: 0.324621 Aug 01 08:14:08.652309 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 592/1182] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:14:08 2022] DELETE /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 08:14:08.661348 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:08.662131 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:08.670954 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.671733 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.672895 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:08.673508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:08.862959 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:08.871643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-730f0bb8-3edc-4978-a252-465d280cd47c tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1470 microversion: 2.1 time: 0.214383 Aug 01 08:14:08.872111 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:08.872441 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 593/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:08 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:08.881063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-adf036ee-d57d-4ea4-a368-6526690652cd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.327089 Aug 01 08:14:08.892094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 591/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:08 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:09.067820 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5506f6af-708d-4ec5-b3dc-d44c650645f6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] Calling method '.version_select at 0x7efe3f6a10d0>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:09.166948 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5506f6af-708d-4ec5-b3dc-d44c650645f6 tempest-TestVolumeBootPattern-853309660 tempest-TestVolumeBootPattern-853309660-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1537120608" status: 202 len: 0 microversion: 2.1 time: 0.102939 Aug 01 08:14:09.167708 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 594/1185] 10.222.0.48 () {58 vars in 1263 bytes} [Mon Aug 1 08:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1537120608 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:14:09.476627 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0e03a12f-f2bc-432a-a1a5-ce9e7fc5c5e1 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47c880d0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:09.506367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-0e03a12f-f2bc-432a-a1a5-ce9e7fc5c5e1 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] HTTP exception thrown: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0e03a12f-f2bc-432a-a1a5-ce9e7fc5c5e1 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Request method failure captured: Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a HTTP/1.1 Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54s77aWwFvjX_T9ln84r-RSPtliCmWPXhrw-_RgcH3-C2kF3DYnuILuJe8jPAqJEs4K-eH_9_RPa0AcruFzaSdAUeDiIumaY7ObmAMwsKPNapuB93aKG-FQ5PZp8oo06kUdnvYC9-3V8eh7djz9XzGCjeEJhe9BnAvkxSbQGtM9ETgk Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:14:09.507172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e0d366348c8470d99ee0c1807fd6c3b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: a067a102409a425ea52cca26794f21c6 Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a'} Aug 01 08:14:09.508993 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. (HTTP 404) (Request-ID: req-b146d8fa-3002-4ed6-97c3-bbccbbbf5f7d) Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.509937 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:14:09.511129 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 08:14:09.512637 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0e03a12f-f2bc-432a-a1a5-ce9e7fc5c5e1 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Returning 404 to user: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0e03a12f-f2bc-432a-a1a5-ce9e7fc5c5e1 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 404 len: 109 microversion: 2.1 time: 0.036047 Aug 01 08:14:09.513862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 592/1186] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:14:09 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:14:09.523216 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4529e640-c44e-4d00-820d-96153891736c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe44080940>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:09.553363 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-4529e640-c44e-4d00-820d-96153891736c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] HTTP exception thrown: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4529e640-c44e-4d00-820d-96153891736c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Request method failure captured: Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: DELETE /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a HTTP/1.1 Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54s77aWwFvjX_T9ln84r-RSPtliCmWPXhrw-_RgcH3-C2kF3DYnuILuJe8jPAqJEs4K-eH_9_RPa0AcruFzaSdAUeDiIumaY7ObmAMwsKPNapuB93aKG-FQ5PZp8oo06kUdnvYC9-3V8eh7djz9XzGCjeEJhe9BnAvkxSbQGtM9ETgk Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:14:09.555412 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e0d366348c8470d99ee0c1807fd6c3b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: a067a102409a425ea52cca26794f21c6 Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a'} Aug 01 08:14:09.557306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. (HTTP 404) (Request-ID: req-48ebe1c3-19ad-4ae3-a77f-8082cd4f8cc5) Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.558153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 08:14:09.559500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 08:14:09.561454 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-4529e640-c44e-4d00-820d-96153891736c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Returning 404 to user: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-4529e640-c44e-4d00-820d-96153891736c tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 404 len: 109 microversion: 2.1 time: 0.037590 Aug 01 08:14:09.562902 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 595/1187] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 08:14:09 2022] DELETE /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:14:09.565686 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4ae9740a-e354-40db-9441-377d4b95c008 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Calling method '.version_select at 0x7efe47cf80d0>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-4ae9740a-e354-40db-9441-377d4b95c008 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] HTTP exception thrown: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4ae9740a-e354-40db-9441-377d4b95c008 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Request method failure captured: Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a HTTP/1.1 Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54s77aWwFvjX_T9ln84r-RSPtliCmWPXhrw-_RgcH3-C2kF3DYnuILuJe8jPAqJEs4K-eH_9_RPa0AcruFzaSdAUeDiIumaY7ObmAMwsKPNapuB93aKG-FQ5PZp8oo06kUdnvYC9-3V8eh7djz9XzGCjeEJhe9BnAvkxSbQGtM9ETgk Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:14:09.597775 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0e0d366348c8470d99ee0c1807fd6c3b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0e0d366348c8470d99ee0c1807fd6c3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 0e0d366348c8470d99ee0c1807fd6c3b Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-200987782 Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: a067a102409a425ea52cca26794f21c6 Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-200987782-project Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a'} Aug 01 08:14:09.599587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. (HTTP 404) (Request-ID: req-f22b7057-7e30-4dd5-9693-6c04db32adf4) Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.600616 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 08:14:09.602059 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 08:14:09.603900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4ae9740a-e354-40db-9441-377d4b95c008 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] Returning 404 to user: Volume 6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4ae9740a-e354-40db-9441-377d4b95c008 tempest-VolumesSnapshotsTestJSON-200987782 tempest-VolumesSnapshotsTestJSON-200987782-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a" status: 404 len: 109 microversion: 2.1 time: 0.037061 Aug 01 08:14:09.605234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 593/1188] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 08:14:09 2022] GET /compute/v2.1/os-volumes/6d98b456-4a7e-4c9b-a9ea-85fbe582ad5a => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:14:09.895224 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:09.897908 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:09.903753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:09.904651 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:09.907037 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:09.907906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:09.909057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:09.910503 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:09.912250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:09.916345 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:09.917481 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:09.918896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:10.083805 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:10.094236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2ebfb1c3-b887-4412-b4a2-3bc1ce1c7df6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1521 microversion: 2.1 time: 0.195837 Aug 01 08:14:10.095510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 594/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:09 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:10.190700 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:10.207858 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-c1c1036f-d242-4000-868b-30b533589f26 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1470 microversion: 2.1 time: 0.317759 Aug 01 08:14:10.227277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 596/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:09 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:11.117428 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:11.118051 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:11.120553 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:11.131962 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:11.132413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:11.133190 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:11.133628 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:11.239254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:11.243413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:11.261804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:11.263554 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:11.264353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:11.265579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:11.390677 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:11.405584 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ff3b5848-9d03-45a1-8fd9-a79c0232fb1a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.288532 Aug 01 08:14:11.407814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 595/1191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:11 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:11.487476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:11.488118 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:11.498553 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:11.500635 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:11.503045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:11.503504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:11.641886 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lazy-loading 'services' on Instance uuid 2a645d07-2702-41b4-b4f0-991d102f6544 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:14:11.804247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:11.807497 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1924c69b-3527-44ce-afa5-e8761060f9ee tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1470 microversion: 2.1 time: 0.575897 Aug 01 08:14:11.808106 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 597/1192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:11 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1470 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:11.931389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9b3b2157-e803-49f8-a9b2-47eb09271626 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544/os-volume_attachments/c32a513f-3408-46fe-b62a-f5d5dd923ec5" status: 202 len: 0 microversion: 2.1 time: 0.448457 Aug 01 08:14:11.932136 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 596/1193] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:14:11 2022] DELETE /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544/os-volume_attachments/c32a513f-3408-46fe-b62a-f5d5dd923ec5 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 08:14:12.091050 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-2272945c-cb81-4b38-8408-2cea6d0822a6 req-54fd09f3-2b1c-4fbd-845c-8ba180d84637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374e07b1-c311-4137-a353-cf03f78d8f55", "name": "network-vif-deleted", "tag": "771e33e8-e43d-4a46-9d88-f765bed9cfa7"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:12.115863 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-2272945c-cb81-4b38-8408-2cea6d0822a6 req-54fd09f3-2b1c-4fbd-845c-8ba180d84637 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:12.116329 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-2272945c-cb81-4b38-8408-2cea6d0822a6 req-54fd09f3-2b1c-4fbd-845c-8ba180d84637 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:12.131039 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-2272945c-cb81-4b38-8408-2cea6d0822a6 req-54fd09f3-2b1c-4fbd-845c-8ba180d84637 service nova] Creating event network-vif-deleted:771e33e8-e43d-4a46-9d88-f765bed9cfa7 for instance 374e07b1-c311-4137-a353-cf03f78d8f55 on hv-cinder-74014 Aug 01 08:14:12.138492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-2272945c-cb81-4b38-8408-2cea6d0822a6 req-54fd09f3-2b1c-4fbd-845c-8ba180d84637 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057270 Aug 01 08:14:12.140027 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 598/1194] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:12.429423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:12.430124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:12.440109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:12.440554 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:12.441323 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:12.441753 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:12.830693 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:12.832303 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:12.842068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:12.842634 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:12.843683 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:12.844255 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:12.875722 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:12.876261 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:12.876779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lazy-loading 'fault' on Instance uuid 374e07b1-c311-4137-a353-cf03f78d8f55 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:14:12.920472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:12.928269 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f29e74db-ea6c-4ddd-a0e2-5b61c3520e68 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1305 microversion: 2.1 time: 0.101962 Aug 01 08:14:12.928854 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 599/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:12 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:12.932117 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:12.940244 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-31c53d53-3d2f-4885-b61c-a94404a50bae tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.515429 Aug 01 08:14:12.940803 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 597/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:12 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:13.959572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:13.959572 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:13.967019 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:13.967475 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:13.968341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:13.968709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:13.971251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:13.972014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:13.981754 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:13.982714 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:13.984254 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:13.984861 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:14.006177 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:14.006628 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:14.007083 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lazy-loading 'fault' on Instance uuid 374e07b1-c311-4137-a353-cf03f78d8f55 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:14:14.012699 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:14.051857 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a878dfa39f546708f65af0cf6abff8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c39845babd94c3898cd13c8b2f0132e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:14.059824 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-97429f35-5714-4871-924a-bc9fcc679411 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 200 len: 1305 microversion: 2.1 time: 0.106606 Aug 01 08:14:14.060506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 600/1197] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:13 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:14.208973 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:14.209525 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:14.224952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:14.224952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:14.224952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:14.224952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:14.234094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:14.247673 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4c75a7be-bdda-4d02-a513-41f5f75dea19 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.285533 Aug 01 08:14:14.248252 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 598/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:13 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:14.250538 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:14:14.589156 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1b3bd918-f014-41ca-8f59-d28e6e21e64b tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 204 len: 0 microversion: 2.1 time: 0.383724 Aug 01 08:14:14.589993 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 601/1199] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:14:14 2022] DELETE /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:14:14.601677 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:14.602296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:14.608970 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:14.609633 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:14.610593 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:14.611334 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:14.750622 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:14.764071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e539f2e4-4ca8-4b7e-892b-1b17a614c5d1 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1513 microversion: 2.1 time: 0.169497 Aug 01 08:14:14.764735 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 599/1200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:14 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:15.081986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:15.083314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] [instance: 374e07b1-c311-4137-a353-cf03f78d8f55] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:15.093910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:15.093910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:15.093910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:15.093910 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:15.117242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] HTTP exception thrown: Instance 374e07b1-c311-4137-a353-cf03f78d8f55 could not be found. Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Request method failure captured: Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 HTTP/1.1 Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54snU4mTIchAQFz2kXQ6ryAq84nfoG1A4FmYjPAqzg-enW_niJtJTbJ6D3FIAHkwraHiBo8N5FIyH3jH5YutjG8iVyQMjrPcLiLnop8j2ruviwwYwzVDIHx7I86zVE9h6RqFBD7FYwMFgV1nN1lWfsfSSyikJ2Zb9AbWN2-GiAqsZeY Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 1c39845babd94c3898cd13c8b2f0132e Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-VolumesNegativeTest-168119612 Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:14:15.118943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c39845babd94c3898cd13c8b2f0132e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c39845babd94c3898cd13c8b2f0132e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c39845babd94c3898cd13c8b2f0132e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c39845babd94c3898cd13c8b2f0132e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-VolumesNegativeTest-168119612 Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 1c39845babd94c3898cd13c8b2f0132e Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-VolumesNegativeTest-168119612 Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-VolumesNegativeTest-168119612-project Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 1a878dfa39f546708f65af0cf6abff8c Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-VolumesNegativeTest-168119612-project Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 374e07b1-c311-4137-a353-cf03f78d8f55 could not be found. Aug 01 08:14:15.130750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '374e07b1-c311-4137-a353-cf03f78d8f55'} Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374e07b1-c311-4137-a353-cf03f78d8f55 could not be found. Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:14:15.131876 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374e07b1-c311-4137-a353-cf03f78d8f55 could not be found. Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374e07b1-c311-4137-a353-cf03f78d8f55 could not be found. Aug 01 08:14:15.133545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:14:15.134986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] Returning 404 to user: Instance 374e07b1-c311-4137-a353-cf03f78d8f55 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:14:15.134986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-81628077-f1a1-459c-ab1c-ecb37d88b3a4 tempest-VolumesNegativeTest-168119612 tempest-VolumesNegativeTest-168119612-project] 10.222.0.48 "GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55" status: 404 len: 111 microversion: 2.1 time: 0.042616 Aug 01 08:14:15.134986 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 602/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:15 2022] GET /compute/v2.1/servers/374e07b1-c311-4137-a353-cf03f78d8f55 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:14:15.268927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:15.269687 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:15.276538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:15.277243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:15.282743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:15.282743 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:15.493161 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:15.506811 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9031d3e0-89d8-493b-819d-bfefc93fa0ac tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.241533 Aug 01 08:14:15.507390 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 600/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:15 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:15.786712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:15.789797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:15.796626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:15.797148 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:15.797913 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:15.798349 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:16.010514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:16.018964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8db57bf7-88b1-467b-8491-f418186f0a6e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1513 microversion: 2.1 time: 0.237058 Aug 01 08:14:16.019558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 603/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:15 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:16.532640 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:16.533817 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:16.545258 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:16.546924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:16.549779 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:16.551085 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:16.815141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:16.823575 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-55f361ef-6251-40b6-8e2c-08bb70a94025 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.296153 Aug 01 08:14:16.838556 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 601/1204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:16 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:17.045090 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:17.045745 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:17.056718 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:17.057182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:17.058058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:17.058579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:17.422368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:17.446871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2eadf206-84a5-4d0f-b7ef-2875102957ae tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1513 microversion: 2.1 time: 0.391648 Aug 01 08:14:17.446871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 604/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:17 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:17.846393 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:17.847235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:17.849499 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-a0a79025-15d5-47fe-b0e2-1fbcc6bfec83 req-098f616b-7908-483d-83f8-e0245ee24e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a645d07-2702-41b4-b4f0-991d102f6544", "name": "network-vif-deleted", "tag": "fc885c8c-34b9-4395-8df9-39a461b1e308"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:17.866582 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:17.867290 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:17.868041 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:17.868631 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:17.877844 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-a0a79025-15d5-47fe-b0e2-1fbcc6bfec83 req-098f616b-7908-483d-83f8-e0245ee24e2c service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:17.888246 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-a0a79025-15d5-47fe-b0e2-1fbcc6bfec83 req-098f616b-7908-483d-83f8-e0245ee24e2c service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:17.899920 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-a0a79025-15d5-47fe-b0e2-1fbcc6bfec83 req-098f616b-7908-483d-83f8-e0245ee24e2c service nova] Creating event network-vif-deleted:fc885c8c-34b9-4395-8df9-39a461b1e308 for instance 2a645d07-2702-41b4-b4f0-991d102f6544 on hv-cinder-74014 Aug 01 08:14:17.905906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-a0a79025-15d5-47fe-b0e2-1fbcc6bfec83 req-098f616b-7908-483d-83f8-e0245ee24e2c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069985 Aug 01 08:14:17.906799 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 602/1206] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:18.094409 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:18.102153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-13f785b5-29a1-4ef5-b8aa-7656144669d7 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.259562 Aug 01 08:14:18.102709 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 605/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:17 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:18.463768 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:18.464473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:18.478356 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:18.479171 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:18.484528 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:18.485180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:18.573907 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:18.575302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:18.575982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lazy-loading 'fault' on Instance uuid 2a645d07-2702-41b4-b4f0-991d102f6544 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:14:18.653090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:18.663100 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-8f155f07-389c-4711-b7e6-d5534ce7d9ea tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 200 len: 1308 microversion: 2.1 time: 0.204060 Aug 01 08:14:18.664348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 603/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:18 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:19.125856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:19.126484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:19.133246 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:19.133702 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:19.143471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:19.143471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:19.324708 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:19.333239 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-36cd2a72-9a71-43f1-bdc6-0b0f9a833fd6 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.212705 Aug 01 08:14:19.334388 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 606/1209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:19 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:19.685644 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:19.686354 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 2a645d07-2702-41b4-b4f0-991d102f6544] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:19.700057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:19.700628 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:19.701397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:19.701756 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:19.718815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] HTTP exception thrown: Instance 2a645d07-2702-41b4-b4f0-991d102f6544 could not be found. Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Request method failure captured: Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 HTTP/1.1 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54r-lu_ulmVeGMerBD7v39ppXlPbO7ZWmlRNBTMMu74M2Uv8ACGbiIZ6LHFP9wBtcNENNpcrgtMzLeYMLTNFIf8794gfelRpj5uvzYkargjP0RClIQxbGND_xfaoR-faFE9rNW3qZih9vLjEL47C6bpE6nAnO2pvr6aaINjvtM8XfT8 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 5e81732f21c54f07bbd838396f6cb0d6 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1751959589 Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:14:19.720751 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5e81732f21c54f07bbd838396f6cb0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5e81732f21c54f07bbd838396f6cb0d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5e81732f21c54f07bbd838396f6cb0d6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5e81732f21c54f07bbd838396f6cb0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesSnapshotTestJSON-1751959589 Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 5e81732f21c54f07bbd838396f6cb0d6 Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1751959589 Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesSnapshotTestJSON-1751959589-project Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 54a4d08f57a24222ac7f28c57cbe3c64 Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesSnapshotTestJSON-1751959589-project Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 2a645d07-2702-41b4-b4f0-991d102f6544 could not be found. Aug 01 08:14:19.722515 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '2a645d07-2702-41b4-b4f0-991d102f6544'} Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a645d07-2702-41b4-b4f0-991d102f6544 could not be found. Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:14:19.723520 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a645d07-2702-41b4-b4f0-991d102f6544 could not be found. Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a645d07-2702-41b4-b4f0-991d102f6544 could not be found. Aug 01 08:14:19.725189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:14:19.727375 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Returning 404 to user: Instance 2a645d07-2702-41b4-b4f0-991d102f6544 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:14:19.728299 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-04545a9f-29b2-4df4-98f9-b15e391c1cc7 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544" status: 404 len: 111 microversion: 2.1 time: 0.046703 Aug 01 08:14:19.732841 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 604/1210] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:19 2022] GET /compute/v2.1/servers/2a645d07-2702-41b4-b4f0-991d102f6544 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:14:20.358254 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:20.358996 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:20.365679 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:20.366165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:20.366905 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:20.367341 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:20.518032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:20.525823 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e903b053-cf7d-4587-8397-e0d610de626a tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.172306 Aug 01 08:14:20.526386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 607/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:20 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:21.818632 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:21.819393 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:21.826108 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:21.826562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:21.827331 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:21.827771 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:21.968205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:21.983141 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-fbe99927-91a0-4579-9e47-3d0b9ece98fb tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.440589 Aug 01 08:14:21.983762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 605/1212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:21 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:23.005306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:23.006011 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:23.008637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:23.014065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:23.014517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:23.016966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:23.016966 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:23.154471 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:23.162265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ead7f1c8-7ce2-49aa-8e2e-d4014e54346e tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.160718 Aug 01 08:14:23.162831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 608/1213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:23 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:24.184535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:24.185175 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:24.191788 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:24.196955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:24.196955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:24.196955 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:24.328977 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:24.336389 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4d50676a-ee85-45dc-86c5-5379373f1dfd tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.156307 Aug 01 08:14:24.336939 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 606/1214] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:24 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:25.360578 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:25.361282 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:25.369964 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:25.370468 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:25.371404 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:25.372170 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:25.560149 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:25.568165 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2c59aea4-51a6-48ce-a29a-bb715e8c0ae3 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.214167 Aug 01 08:14:25.568732 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 609/1215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:25 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:26.592492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:26.592492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:26.599089 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:26.599702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:26.600486 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:26.600924 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:26.608478 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-e55a1658-da62-43f9-828b-7f30498630d5 req-21cdce74-3f82-4b8c-bee1-f4eccf649dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "name": "network-vif-plugged", "status": "completed", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:26.617046 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:26.620018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-e55a1658-da62-43f9-828b-7f30498630d5 req-21cdce74-3f82-4b8c-bee1-f4eccf649dba service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:26.620519 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-e55a1658-da62-43f9-828b-7f30498630d5 req-21cdce74-3f82-4b8c-bee1-f4eccf649dba service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:26.632611 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-e55a1658-da62-43f9-828b-7f30498630d5 req-21cdce74-3f82-4b8c-bee1-f4eccf649dba service nova] Creating event network-vif-plugged:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:14:26.638523 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-e55a1658-da62-43f9-828b-7f30498630d5 req-21cdce74-3f82-4b8c-bee1-f4eccf649dba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Aug 01 08:14:26.639145 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 610/1216] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 08:14:26.770583 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:26.780079 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-197e15f4-0dc5-4975-b2c7-ee6579bb5542 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.193782 Aug 01 08:14:26.780903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 607/1217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:26 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:27.806081 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:27.806790 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:27.813669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:27.814123 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:27.814891 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:27.815331 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:27.954201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:27.962323 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-51e30b91-303e-4275-b3a3-e18aa8cac67f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.160890 Aug 01 08:14:27.962984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 611/1218] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:27 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:28.984163 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:28.984777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:28.990784 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:28.991234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:28.992027 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:28.992469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:29.126454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:29.133927 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5379ed52-1c6e-46e5-9ab0-0844b44cb09c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.153877 Aug 01 08:14:29.134489 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 608/1219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:28 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:30.158530 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:30.159164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:30.165801 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:30.166256 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:30.167032 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:30.167750 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:30.299563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:30.307176 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ceeff1e7-e0d3-407c-9004-c16bc212509c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.152739 Aug 01 08:14:30.307760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 612/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:30 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:31.337624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:31.338367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:31.345352 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:31.346002 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:31.346780 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:31.347214 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:31.485122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:31.492755 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6705bf3e-8e3b-4501-92e3-a4000ee49319 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1577 microversion: 2.1 time: 0.159155 Aug 01 08:14:31.493316 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 609/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:31 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:32.418232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2020813607", "imageRef": "53abae5d-df2f-446f-bad6-d7eccb45a4dd", "flavorRef": "452", "networks": [{"uuid": "0bc763cf-0ca7-4382-93d1-72a9a8469962"}]}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:32.473067 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.network.neutron [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] validate_networks() for [('0bc763cf-0ca7-4382-93d1-72a9a8469962', None, None, None, None, None)] {{(pid=118233) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:14:32.514258 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:32.514867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:32.521382 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:32.521825 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:32.522590 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:32.523022 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:32.654806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:32.662488 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-77e4adc7-5c8b-47f7-b30f-38727c09abee tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1564 microversion: 2.1 time: 0.152603 Aug 01 08:14:32.663057 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 610/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:32 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:32.928932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Flavor limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:14:32.929354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Image limits 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:14:32.929825 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Flavor pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:14:32.930232 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Image pref 0:0:0 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:14:32.930659 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.virt.hardware [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118233) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:14:32.940035 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:32.940485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:32.941278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:32.941716 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:32.959013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Getting quotas for project 5e81732f21c54f07bbd838396f6cb0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:14:32.963202 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Getting quotas for user 54a4d08f57a24222ac7f28c57cbe3c64 and project 5e81732f21c54f07bbd838396f6cb0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:14:32.974676 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Going to run 1 instances... {{(pid=118233) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:14:32.976963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53abae5d-df2f-446f-bad6-d7eccb45a4dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118233) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:14:33.104003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-50dd91ce-9919-4514-ba0c-fd16214eaaf9 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689780 Aug 01 08:14:33.104651 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 613/1223] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:14:33.116095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-66e03fb4-6095-4345-b845-be9fba58a886 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:33.116900 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-66e03fb4-6095-4345-b845-be9fba58a886 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:33.170997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-66e03fb4-6095-4345-b845-be9fba58a886 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:33.177747 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-66e03fb4-6095-4345-b845-be9fba58a886 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1219 microversion: 2.1 time: 0.065512 Aug 01 08:14:33.178302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 611/1224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:33 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:34.200860 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:34.201386 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:34.208951 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:34.209408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:34.210183 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:34.210625 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:34.280186 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:34.287697 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d0c08885-186e-419b-97c5-63718a4f8c19 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1223 microversion: 2.1 time: 0.091486 Aug 01 08:14:34.288334 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 614/1225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:34 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:35.310261 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:35.311415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:35.318476 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:35.319014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:35.319946 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:35.320642 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:35.393179 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:35.401030 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-bcf85234-0d34-4aae-ab48-20a6f1b51c3a tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1289 microversion: 2.1 time: 0.095933 Aug 01 08:14:35.402327 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 612/1226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:35 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:36.424898 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:36.426991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:36.434492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:36.435135 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:36.436118 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:36.437325 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:36.662969 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:36.671640 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a1d34225-2b63-4889-97a5-ed5cfeb66559 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.252176 Aug 01 08:14:36.672496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 615/1227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:36 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:36.983978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-88286cb1-6e4d-4244-bf5c-1b8d38a75e56 req-daba802f-c27f-4c2b-a6ad-3dee28ebbd09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c0064a7-da4f-4b97-ae36-f3414ac734a6", "tag": "18dbd6f6-679c-4d69-bce7-b27b9e753716"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:36.994168 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-88286cb1-6e4d-4244-bf5c-1b8d38a75e56 req-daba802f-c27f-4c2b-a6ad-3dee28ebbd09 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:36.994619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-88286cb1-6e4d-4244-bf5c-1b8d38a75e56 req-daba802f-c27f-4c2b-a6ad-3dee28ebbd09 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:37.007896 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-88286cb1-6e4d-4244-bf5c-1b8d38a75e56 req-daba802f-c27f-4c2b-a6ad-3dee28ebbd09 service nova] Creating event network-changed:18dbd6f6-679c-4d69-bce7-b27b9e753716 for instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 on hv-cinder-74014 Aug 01 08:14:37.013558 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-88286cb1-6e4d-4244-bf5c-1b8d38a75e56 req-daba802f-c27f-4c2b-a6ad-3dee28ebbd09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Aug 01 08:14:37.014153 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 613/1228] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:37.695130 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:37.695130 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:37.699757 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:37.700265 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:37.700978 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:37.701414 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:37.833637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:37.841663 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a0b5f66b-42a3-4b3a-8a24-14854106cf88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.152827 Aug 01 08:14:37.842274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 616/1229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:37 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:38.863408 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:38.865877 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:38.870551 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:38.871470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:38.872227 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:38.872655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:39.009127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:39.017443 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-9d3aaaba-0adf-4ec3-b236-8483eba31b88 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.158673 Aug 01 08:14:39.018273 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 614/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:38 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:40.038326 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:40.038929 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:40.045883 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:40.046336 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:40.047100 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:40.047561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:40.065164 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:40.180512 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:40.190367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-1091085b-8797-42d1-84ef-af2811f0143f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.155926 Aug 01 08:14:40.190932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 617/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:40 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:41.211966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:41.212535 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:41.219657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:41.220109 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:41.220868 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:41.221302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:41.349969 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:41.357957 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d7d41b5d-4611-4683-9f3f-96de10123b0f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.149848 Aug 01 08:14:41.358527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 615/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:41 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:42.378229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:42.378848 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:42.385300 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:42.385758 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:42.386502 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:42.386939 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:42.519950 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:42.527878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-00e65e44-cf2d-4f7a-b34f-2cf20ab0a65f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.153539 Aug 01 08:14:42.528588 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 618/1233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:42 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:43.550095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:43.550682 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:43.553183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:43.553830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=46 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:43.558523 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:43.558966 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:43.559738 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:43.560167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:43.694612 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:43.702127 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0a920402-a57f-4c0b-88f8-bf892f9e67ba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.156332 Aug 01 08:14:43.702657 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 616/1234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:43 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:44.722411 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:44.723059 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:44.724932 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:44.725599 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=6 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:14:44.730888 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:44.731314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:44.732182 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:44.737161 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:44.743916 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-e2da20aa-2dfb-43ba-92d1-4239ed6cc589 req-028c9c92-1db4-4126-9016-bb75465630fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0064a7-da4f-4b97-ae36-f3414ac734a6", "name": "network-vif-plugged", "status": "completed", "tag": "18dbd6f6-679c-4d69-bce7-b27b9e753716"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:44.755045 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-e2da20aa-2dfb-43ba-92d1-4239ed6cc589 req-028c9c92-1db4-4126-9016-bb75465630fe service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:44.755415 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-e2da20aa-2dfb-43ba-92d1-4239ed6cc589 req-028c9c92-1db4-4126-9016-bb75465630fe service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:44.767200 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-e2da20aa-2dfb-43ba-92d1-4239ed6cc589 req-028c9c92-1db4-4126-9016-bb75465630fe service nova] Creating event network-vif-plugged:18dbd6f6-679c-4d69-bce7-b27b9e753716 for instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 on hv-cinder-74014 Aug 01 08:14:44.772322 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-e2da20aa-2dfb-43ba-92d1-4239ed6cc589 req-028c9c92-1db4-4126-9016-bb75465630fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 Aug 01 08:14:44.773118 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 617/1235] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:14:44.888178 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:44.896746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-889bbdfe-6079-4c5c-bef9-d719101ff1d5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.178291 Aug 01 08:14:44.897321 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 619/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:44 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:45.919635 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:45.920250 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:45.926659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:45.927110 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:45.927895 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:45.928333 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:46.056288 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:46.064596 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4bf071a1-2055-4cc9-a2b3-2ead00e24f2d tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1319 microversion: 2.1 time: 0.150058 Aug 01 08:14:46.065164 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 618/1237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:45 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:14:47.085623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:14:47.086368 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:47.092924 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:47.093413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:47.094279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:47.094721 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:47.269637 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:14:47.277306 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e92b6f93-2447-4abb-aacf-8c55b9b0a078 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1508 microversion: 2.1 time: 0.195623 Aug 01 08:14:47.282219 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 620/1238] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:14:47 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:14:47.298226 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c3b11eb-a070-4b0b-aa5d-1442f30a0396", "device": "/dev/sdb"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:14:47.301065 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:14:47.307469 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:47.307939 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:47.308691 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:14:47.309120 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:14:48.025407 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-c284a863-fe58-4d5c-94dd-13f2ab2ffa9e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "POST /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731422 Aug 01 08:14:48.026012 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 619/1239] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:14:47 2022] POST /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6/os-volume_attachments => generated 194 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:15:10.050205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:10.050699 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:10.052894 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:15:10.053545 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=20 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:15:10.060474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:10.060474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:10.060474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:10.060474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:10.142424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lazy-loading 'services' on Instance uuid 8c0064a7-da4f-4b97-ae36-f3414ac734a6 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:15:10.409108 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-38fcbea6-b143-4a0a-a6eb-46e54c42905e tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6/os-volume_attachments/1c3b11eb-a070-4b0b-aa5d-1442f30a0396" status: 202 len: 0 microversion: 2.1 time: 0.362533 Aug 01 08:15:10.409652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 621/1240] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:15:10 2022] DELETE /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6/os-volume_attachments/1c3b11eb-a070-4b0b-aa5d-1442f30a0396 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:15:11.550189 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=7 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:15:11.552181 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:15:11.555355 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:11.555959 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:11.562033 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:11.562479 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:11.563233 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:11.563698 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:11.591473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Going to try to terminate instance {{(pid=118232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:15:11.826976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b7b97114-5195-4312-b8a3-0d57257a66b3 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 204 len: 0 microversion: 2.1 time: 0.278061 Aug 01 08:15:11.827588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 620/1241] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:15:11 2022] DELETE /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:15:11.836885 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:11.837592 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:11.844168 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:11.844629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:11.845397 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:11.845841 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:11.978446 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:15:11.986075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-35036644-68a9-42fc-a3b9-eeafff3aeb1f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1514 microversion: 2.1 time: 0.153894 Aug 01 08:15:11.986644 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 622/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:15:11 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:15:13.011903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:13.012702 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:13.019218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:13.019699 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:13.020487 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:13.020915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:13.164914 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:15:13.172928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b257357a-b485-4b0c-8a26-b893ab5952a5 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1514 microversion: 2.1 time: 0.165402 Aug 01 08:15:13.173510 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 621/1243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:15:13 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:15:14.201021 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:14.201639 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:14.208460 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:14.208909 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:14.209907 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:14.210356 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:14.520673 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:15:14.529527 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-feb40f35-d65b-4852-b1f7-0a66c7155bba tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1514 microversion: 2.1 time: 0.332422 Aug 01 08:15:14.530208 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 623/1244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:15:14 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1514 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:15:14.781158 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-7a20db59-b33c-4e90-84fd-247e48b64766 req-d2e136f2-4787-4321-b249-63d55b5dedb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c0064a7-da4f-4b97-ae36-f3414ac734a6", "name": "network-vif-deleted", "tag": "18dbd6f6-679c-4d69-bce7-b27b9e753716"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:15:14.791948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-7a20db59-b33c-4e90-84fd-247e48b64766 req-d2e136f2-4787-4321-b249-63d55b5dedb2 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:14.794824 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-7a20db59-b33c-4e90-84fd-247e48b64766 req-d2e136f2-4787-4321-b249-63d55b5dedb2 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:14.803655 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-7a20db59-b33c-4e90-84fd-247e48b64766 req-d2e136f2-4787-4321-b249-63d55b5dedb2 service nova] Creating event network-vif-deleted:18dbd6f6-679c-4d69-bce7-b27b9e753716 for instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 on hv-cinder-74014 Aug 01 08:15:14.808400 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-7a20db59-b33c-4e90-84fd-247e48b64766 req-d2e136f2-4787-4321-b249-63d55b5dedb2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Aug 01 08:15:14.808976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 622/1245] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:15:15.552275 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:15.552926 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:15.559274 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:15.559761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:15.560518 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:15.560953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:15.592762 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:15.593203 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:15.593652 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lazy-loading 'fault' on Instance uuid 8c0064a7-da4f-4b97-ae36-f3414ac734a6 {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:15:15.634427 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a4d08f57a24222ac7f28c57cbe3c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e81732f21c54f07bbd838396f6cb0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:15:15.642314 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-02ba2944-2d35-41c5-86b0-8232d694137f tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 200 len: 1309 microversion: 2.1 time: 0.093969 Aug 01 08:15:15.647552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 624/1246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:15:15 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:15:16.665835 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:15:16.666862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] [instance: 8c0064a7-da4f-4b97-ae36-f3414ac734a6] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:15:16.673047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:16.673490 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:16.674361 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:15:16.674790 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:15:16.688391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] HTTP exception thrown: Instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 could not be found. Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Request method failure captured: Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 HTTP/1.1 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54r-lu_ulmVeGMerBD7v39ppXlPbO7ZWmlRNBTMMu74M2Uv8ACGbiIZ6LHFP9wBtcNENNpcrgtMzLeYMLTNFIf8794gfelRpj5uvzYkargjP0RClIQxbGND_xfaoR-faFE9rNW3qZih9vLjEL47C6bpE6nAnO2pvr6aaINjvtM8XfT8 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 5e81732f21c54f07bbd838396f6cb0d6 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1751959589 Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:15:16.689983 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5e81732f21c54f07bbd838396f6cb0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5e81732f21c54f07bbd838396f6cb0d6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5e81732f21c54f07bbd838396f6cb0d6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5e81732f21c54f07bbd838396f6cb0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-VolumesSnapshotTestJSON-1751959589 Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 5e81732f21c54f07bbd838396f6cb0d6 Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1751959589 Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-VolumesSnapshotTestJSON-1751959589-project Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 54a4d08f57a24222ac7f28c57cbe3c64 Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-VolumesSnapshotTestJSON-1751959589-project Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 could not be found. Aug 01 08:15:16.691777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'id': '8c0064a7-da4f-4b97-ae36-f3414ac734a6'} Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 could not be found. Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:15:16.692759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 could not be found. Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 could not be found. Aug 01 08:15:16.694681 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:15:16.696272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] Returning 404 to user: Instance 8c0064a7-da4f-4b97-ae36-f3414ac734a6 could not be found. {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:15:16.696272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b3ce59fb-b402-4b88-a35b-b749a8a98e14 tempest-VolumesSnapshotTestJSON-1751959589 tempest-VolumesSnapshotTestJSON-1751959589-project] 10.222.0.48 "GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6" status: 404 len: 111 microversion: 2.1 time: 0.030733 Aug 01 08:15:16.696272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 623/1247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:15:16 2022] GET /compute/v2.1/servers/8c0064a7-da4f-4b97-ae36-f3414ac734a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:16:06.528148 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:16:06.528850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Mon Aug 1 08:16:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:16:07.926150 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6143f205-75ff-4815-abc3-5d22bd6907b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Action: 'create', calling method: .version_select at 0x7efe3f5b6700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-629073726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2pPuYO6btQbntJMdMMsOtoM4B5gBEeq33PSh6lzeGnWsMVigyAd3cLTPX0vRa4vilEoTaK1qNK7OAImzkIqF435zxom01cmAYMiY/l3G/SSIRWdhRo4cz7mq5IyQO70A=="}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:07.933214 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=10 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:07.933812 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:07.942984 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-6143f205-75ff-4815-abc3-5d22bd6907b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Getting quotas for project 73e81c6e477a41ddb15e47b0c486b33e. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:16:07.949491 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.quota [None req-6143f205-75ff-4815-abc3-5d22bd6907b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Getting quotas for user 7d9d2555e71d4459b4fb907b764c1e79 and project 73e81c6e477a41ddb15e47b0c486b33e. Resources: {'key_pairs'} {{(pid=118233) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:16:08.084129 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6143f205-75ff-4815-abc3-5d22bd6907b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.161755 Aug 01 08:16:08.084723 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 625/1248] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 08:16:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:08.136274 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-552759271", "imageRef": "0be1f0b4-d92a-40ed-a550-d3ded02bce91", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-629073726", "networks": [{"uuid": "454bfb86-ae42-45ca-9268-83adb7854d8f"}]}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:08.145312 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:08.155860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:08.300255 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.network.neutron [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] validate_networks() for [('454bfb86-ae42-45ca-9268-83adb7854d8f', None, None, None, None, None)] {{(pid=118232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 08:16:08.670000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Flavor limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 08:16:08.670409 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Image limits 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 08:16:08.670880 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Flavor pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 08:16:08.671300 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Image pref 0:0:0 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 08:16:08.671733 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.virt.hardware [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 08:16:08.680462 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:08.681396 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:08.682267 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:08.682693 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:08.699559 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Getting quotas for project 73e81c6e477a41ddb15e47b0c486b33e. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 08:16:08.703675 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.quota [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Getting quotas for user 7d9d2555e71d4459b4fb907b764c1e79 and project 73e81c6e477a41ddb15e47b0c486b33e. Resources: {'instances', 'cores', 'ram'} {{(pid=118232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 08:16:08.715234 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Going to run 1 instances... {{(pid=118232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 08:16:08.717560 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0be1f0b4-d92a-40ed-a550-d3ded02bce91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 08:16:08.838928 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-e322efa4-9278-4a49-8565-eba1ad526861 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706766 Aug 01 08:16:08.839701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 624/1249] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 08:16:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 08:16:08.851013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d862adb4-e7ea-4708-81b9-046cc4a9c0af tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:08.851776 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d862adb4-e7ea-4708-81b9-046cc4a9c0af tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:09.007394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d862adb4-e7ea-4708-81b9-046cc4a9c0af tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:09.015004 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d862adb4-e7ea-4708-81b9-046cc4a9c0af tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1257 microversion: 2.1 time: 0.168302 Aug 01 08:16:09.015494 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 626/1250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:08 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:10.035926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f8a987ec-d47c-43d3-9f9d-00c169e480d2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:10.036472 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f8a987ec-d47c-43d3-9f9d-00c169e480d2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:10.093201 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f8a987ec-d47c-43d3-9f9d-00c169e480d2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:10.099873 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f8a987ec-d47c-43d3-9f9d-00c169e480d2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1257 microversion: 2.1 time: 0.068466 Aug 01 08:16:10.100514 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 625/1251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:10 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:11.119953 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5453abca-0097-40b4-8b2b-c63c92148bfe tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:11.120565 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5453abca-0097-40b4-8b2b-c63c92148bfe tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:11.176850 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5453abca-0097-40b4-8b2b-c63c92148bfe tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:11.183597 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5453abca-0097-40b4-8b2b-c63c92148bfe tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1257 microversion: 2.1 time: 0.067733 Aug 01 08:16:11.184157 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 627/1252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:11 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:12.204948 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-4a31c393-e650-4447-af3a-053f5bb40fb9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:12.205574 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-4a31c393-e650-4447-af3a-053f5bb40fb9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:12.258932 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-4a31c393-e650-4447-af3a-053f5bb40fb9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:12.266071 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-4a31c393-e650-4447-af3a-053f5bb40fb9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1257 microversion: 2.1 time: 0.065027 Aug 01 08:16:12.266633 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 626/1253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:12 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:13.287772 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:13.288363 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:13.295828 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:13.296281 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:13.297053 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:13.297521 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:13.359417 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:13.366804 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-523bbb1b-b9fa-4b74-acea-c7d43989c6ee tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1261 microversion: 2.1 time: 0.083025 Aug 01 08:16:13.367360 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 628/1254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:13 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:16:14.388878 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:14.389538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:14.396979 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:14.404517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:14.404517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:14.404517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:14.464650 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:14.473703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d5658b2b-5e7c-40c8-b2bd-014945a504b0 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1253 microversion: 2.1 time: 0.088433 Aug 01 08:16:14.474474 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 627/1255] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:14 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:15.542941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:15.546550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:15.552943 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:15.553405 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:15.554190 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:15.554623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:15.915353 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:15.926990 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-83a13cb4-69cf-4a62-b970-3180dba19cd4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1315 microversion: 2.1 time: 0.389673 Aug 01 08:16:15.943942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 629/1256] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:15 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:16.952460 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:16.953070 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:16.959631 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:16.960084 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:16.960850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:16.961289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:17.108862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:17.116960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-3cd3da88-85ae-49f0-9bf4-d25e9ef597b9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.168265 Aug 01 08:16:17.118378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 628/1257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:16 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:18.138653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:18.141764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:18.146474 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:18.146997 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:18.147793 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:18.148227 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:18.285665 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:18.294367 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d7d1ea6c-0bc8-4f47-9101-1084f7cedd34 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.159622 Aug 01 08:16:18.295276 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 630/1258] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:18 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:19.317280 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:19.318647 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:19.322563 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=2 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:19.326762 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:19.327167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:19.327976 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:19.328418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:19.468806 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:19.476258 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b715a6d5-3555-4254-95ea-744902a5a5f4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.163397 Aug 01 08:16:19.477606 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 629/1259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:19 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:16:20.498601 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:20.499952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:20.506856 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:20.507313 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:20.508781 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:20.509458 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:20.650205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:20.663299 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-211e9281-2001-4c71-9a8c-b221d5678617 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.168812 Aug 01 08:16:20.667060 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 631/1260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:20 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:21.684934 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:21.685703 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:21.692413 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:21.692867 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:21.693638 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:21.694075 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:21.831124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:21.839941 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-37488770-891e-48f8-939f-c1f5e418714d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.158882 Aug 01 08:16:21.840810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 630/1261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:21 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:22.862088 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:22.862778 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:22.864584 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=8 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:22.869994 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:22.870442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:22.871248 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:22.871716 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:23.016963 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:23.025413 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-2a7a564a-e455-4eef-9509-24122092598c tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.167068 Aug 01 08:16:23.025991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 632/1262] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:22 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:24.046564 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:24.047101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:24.048912 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell0:SELECT=10 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:24.054395 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:24.054851 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:24.055654 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:24.056832 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:24.187292 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:24.194640 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f557e96e-96b1-489b-8012-3d900340cbb1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.152024 Aug 01 08:16:24.195199 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 631/1263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:24 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:25.216081 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:25.216764 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:25.223408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:25.223958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:25.224779 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:25.225220 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:25.363712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:25.371195 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e1f1dd3e-3dcf-41cc-a21a-df92bc8f5194 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.159680 Aug 01 08:16:25.371797 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 633/1264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:25 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:26.391356 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:26.391996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:26.398384 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:26.398829 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:26.399664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:26.400112 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:26.534664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:26.543309 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2b804e69-2fc7-49e3-8bca-36900eec36a9 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.155751 Aug 01 08:16:26.543917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 632/1265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:26 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:27.486542 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-30b1f750-af66-434a-8366-2838463ae457 req-4b6896a5-a0d7-4d99-b136-650b50311550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:27.497484 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-30b1f750-af66-434a-8366-2838463ae457 req-4b6896a5-a0d7-4d99-b136-650b50311550 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:27.498016 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-30b1f750-af66-434a-8366-2838463ae457 req-4b6896a5-a0d7-4d99-b136-650b50311550 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:27.509247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-30b1f750-af66-434a-8366-2838463ae457 req-4b6896a5-a0d7-4d99-b136-650b50311550 service nova] Creating event network-changed:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:16:27.515075 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-30b1f750-af66-434a-8366-2838463ae457 req-4b6896a5-a0d7-4d99-b136-650b50311550 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032228 Aug 01 08:16:27.515695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 634/1266] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:27.564713 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:27.565262 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:27.572094 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:27.573146 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:27.573898 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:27.574337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:27.703492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:27.712348 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-0b859089-0d94-41f5-bd20-31a94872334d tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.151697 Aug 01 08:16:27.712925 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 633/1267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:27 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:28.734144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:28.734844 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:28.741051 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:28.741514 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:28.742268 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:28.742705 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:28.868529 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:28.876630 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-ada29f54-c722-47b5-9a13-b8c26834c159 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.147229 Aug 01 08:16:28.877203 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 635/1268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:28 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:29.898297 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:29.898903 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:29.905501 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:29.905950 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:29.906704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:29.907140 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:30.036603 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:30.045048 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cba52d4b-eadd-4ac1-8c7f-ee1d7bbaed80 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.150617 Aug 01 08:16:30.058978 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 634/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:29 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:30.937068 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:30.937594 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:30.938685 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-2bdea016-eb6e-4837-a569-72645e738697 req-3740b963-3177-4cbc-80bc-7f0134a93430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:30.944121 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:30.944826 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:30.945794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:30.946408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:30.950597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-2bdea016-eb6e-4837-a569-72645e738697 req-3740b963-3177-4cbc-80bc-7f0134a93430 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:30.951041 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-2bdea016-eb6e-4837-a569-72645e738697 req-3740b963-3177-4cbc-80bc-7f0134a93430 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:30.962701 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-2bdea016-eb6e-4837-a569-72645e738697 req-3740b963-3177-4cbc-80bc-7f0134a93430 service nova] Creating event network-changed:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:16:30.969906 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-2bdea016-eb6e-4837-a569-72645e738697 req-3740b963-3177-4cbc-80bc-7f0134a93430 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034740 Aug 01 08:16:30.970860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 635/1270] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:30.975259 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:16:31.067195 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:31.068530 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:31.076961 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:31.077708 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:31.079918 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:31.084969 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:31.249330 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:31.258370 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-766fb32a-4c75-4663-ab31-0dd4692e7aaf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.195716 Aug 01 08:16:31.259144 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 636/1271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:31 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:16:31.316558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5e95c895-7a27-4a1f-9dee-6b5f2f8ed36c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 204 len: 0 microversion: 2.1 time: 0.383136 Aug 01 08:16:31.317247 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 636/1272] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:16:30 2022] DELETE /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:16:31.326196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:31.326812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:31.333017 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:31.333492 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:31.334260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:31.334696 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:31.474221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:31.482252 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-90670592-91c7-43ae-b5ba-3baa33c0c8f5 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.160660 Aug 01 08:16:31.482823 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 637/1273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:31 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:32.281867 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:32.282500 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:32.289301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:32.289754 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:32.290579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:32.291091 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:32.504343 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:32.504956 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:32.512423 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:32.512879 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:32.513662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:32.514097 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:32.653995 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:32.661866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-97e734e9-cab1-41ca-afd6-6251334d029f tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1570 microversion: 2.1 time: 0.161381 Aug 01 08:16:32.662458 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 638/1274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:32 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 08:16:32.760438 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:32.768089 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5304eeaa-5e28-43e7-98c9-78cab25e50cf tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.491350 Aug 01 08:16:32.774126 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 637/1275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:32 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:33.284019 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-ea6c8e51-a7b0-45b6-a0ef-19b146dfda59 req-15e0a917-1ecc-4bc2-8440-b01fceac5694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "name": "network-vif-plugged", "status": "completed", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:33.296162 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-ea6c8e51-a7b0-45b6-a0ef-19b146dfda59 req-15e0a917-1ecc-4bc2-8440-b01fceac5694 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:33.296624 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-ea6c8e51-a7b0-45b6-a0ef-19b146dfda59 req-15e0a917-1ecc-4bc2-8440-b01fceac5694 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:33.309076 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-ea6c8e51-a7b0-45b6-a0ef-19b146dfda59 req-15e0a917-1ecc-4bc2-8440-b01fceac5694 service nova] Creating event network-vif-plugged:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:16:33.315124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-ea6c8e51-a7b0-45b6-a0ef-19b146dfda59 req-15e0a917-1ecc-4bc2-8440-b01fceac5694 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095851 Aug 01 08:16:33.315124 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 639/1276] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:33.504579 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-a74ba0d7-076a-43f2-ab62-0d8a0c79d4d1 req-7a4fe662-512a-48eb-b478-5e82aa2a845a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1208d5e5-44c4-4a20-808f-f2c798a96f61", "name": "network-vif-deleted", "tag": "495c441b-33da-4c46-b71c-f1dbceb31679"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:33.514317 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-a74ba0d7-076a-43f2-ab62-0d8a0c79d4d1 req-7a4fe662-512a-48eb-b478-5e82aa2a845a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:33.514761 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-a74ba0d7-076a-43f2-ab62-0d8a0c79d4d1 req-7a4fe662-512a-48eb-b478-5e82aa2a845a service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:33.528217 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-a74ba0d7-076a-43f2-ab62-0d8a0c79d4d1 req-7a4fe662-512a-48eb-b478-5e82aa2a845a service nova] Creating event network-vif-deleted:495c441b-33da-4c46-b71c-f1dbceb31679 for instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 on hv-cinder-74014 Aug 01 08:16:33.532906 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-a74ba0d7-076a-43f2-ab62-0d8a0c79d4d1 req-7a4fe662-512a-48eb-b478-5e82aa2a845a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032032 Aug 01 08:16:33.536955 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 638/1277] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:33.684785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:33.686621 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:33.691892 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:33.692337 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:33.693096 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:33.693527 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:33.755221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:33.763711 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-f53140a7-7cfc-4838-80b2-f9683afd4204 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1220 microversion: 2.1 time: 0.083729 Aug 01 08:16:33.764291 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 640/1278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:33 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:33.790506 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:33.791354 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:33.798279 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:33.798725 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:33.799492 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:33.800022 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:33.940289 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:33.948205 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-491447de-5206-4195-9fe9-7087195254bc tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.162695 Aug 01 08:16:33.948893 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 639/1279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:33 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:34.784982 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:34.785619 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:34.793270 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:34.793763 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:34.794524 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:34.794960 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:34.861973 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:34.869538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-a49e8d81-147d-42b1-a0c1-fa769bbc19c9 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1220 microversion: 2.1 time: 0.088542 Aug 01 08:16:34.870099 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 641/1280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:34 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:34.969057 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:34.969660 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:34.976144 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:34.976648 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:34.977400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:34.977831 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:35.107712 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:35.115159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-757c3240-d256-470d-961e-1e295ab1dad4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1357 microversion: 2.1 time: 0.150014 Aug 01 08:16:35.115760 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 640/1281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:34 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:35.889546 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:35.890160 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:35.896801 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:35.897271 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:35.898032 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:35.898465 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:35.930377 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:35.930827 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:35.931272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lazy-loading 'fault' on Instance uuid 1208d5e5-44c4-4a20-808f-f2c798a96f61 {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:16:35.972947 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc01a0e20fd411b9df5d2f077784f33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb938950a17942b9b4b1ca56f319e754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:35.981659 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-d1b5666c-ee94-403e-9596-46830894b20c tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 200 len: 1179 microversion: 2.1 time: 0.096041 Aug 01 08:16:35.982237 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 642/1282] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:35 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 1179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:36.136832 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:36.137429 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:36.143862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.144308 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.145058 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.145489 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.273788 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:36.282153 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-38d2a24c-df0a-4b99-af88-74dd65c5c009 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1546 microversion: 2.1 time: 0.149759 Aug 01 08:16:36.282754 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 641/1283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:36 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:36.302604 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:36.303245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:36.309890 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.310349 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.311106 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.311562 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.443513 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:36.451647 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-2909c4f2-cb9c-4118-9819-2e8d9c6cdc25 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1546 microversion: 2.1 time: 0.152786 Aug 01 08:16:36.452219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 643/1284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:36 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:36.471318 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:36.476049 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:36.476805 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Searching by: {'deleted': False, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e'} {{(pid=118233) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 08:16:36.483394 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.483871 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.484686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.485310 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.573892 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.multi_cell_list [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118233) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 08:16:36.667418 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-de713df3-881b-4731-83a6-6262b4b617c4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199233 Aug 01 08:16:36.668014 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 642/1285] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Aug 1 08:16:36 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:36.679018 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:36.679693 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:36.686529 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.686987 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.687780 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:36.688219 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:36.692194 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=100 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:36.821852 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:36.830526 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-5776c9d6-bada-472f-9258-2b1735a5d716 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1546 microversion: 2.1 time: 0.155267 Aug 01 08:16:36.831115 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 644/1286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:36 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:37.007845 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:37.008457 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] [instance: 1208d5e5-44c4-4a20-808f-f2c798a96f61] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:37.015251 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:37.015552 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:37.016278 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:37.016714 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:37.030653 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] HTTP exception thrown: Instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 could not be found. Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Request method failure captured: Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 HTTP/1.1 Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54opcjnS5whmnYm2cUpi2-Gj_m-UJXFiuHsvZ_C8HJVwdn3VTsbvxJzoBiS-me-w-BPePSbtZ5b6MUeX10ScesgGmEpGsw2CATslWSI0IIYaGirSkooHkp9fx5dDE5oHhBrJoxLtcAs6jDpy9Hmod93AfRSGTQ5ZVh0T0TozUZUCM3o Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: eb938950a17942b9b4b1ca56f319e754 Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-TestShelveInstance-542435417 Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:16:37.032301 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb938950a17942b9b4b1ca56f319e754"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb938950a17942b9b4b1ca56f319e754"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb938950a17942b9b4b1ca56f319e754", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb938950a17942b9b4b1ca56f319e754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-TestShelveInstance-542435417 Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: eb938950a17942b9b4b1ca56f319e754 Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-TestShelveInstance-542435417 Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-TestShelveInstance-542435417-project Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 1bc01a0e20fd411b9df5d2f077784f33 Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-TestShelveInstance-542435417-project Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 could not be found. Aug 01 08:16:37.034134 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '1208d5e5-44c4-4a20-808f-f2c798a96f61'} Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 could not be found. Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:16:37.035143 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 could not be found. Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 could not be found. Aug 01 08:16:37.036669 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:16:37.038115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Returning 404 to user: Instance 1208d5e5-44c4-4a20-808f-f2c798a96f61 could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:16:37.038115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-a5551228-e155-4358-802a-15cd076fc3f0 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61" status: 404 len: 111 microversion: 2.1 time: 0.029797 Aug 01 08:16:37.038115 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 643/1287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:37 2022] GET /compute/v2.1/servers/1208d5e5-44c4-4a20-808f-f2c798a96f61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:16:37.259243 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-75fb927b-d4a8-47f4-9215-c1e314e44547 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] Calling method '.version_select at 0x7efe47c88430>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:37.346095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-75fb927b-d4a8-47f4-9215-c1e314e44547 tempest-TestShelveInstance-542435417 tempest-TestShelveInstance-542435417-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1395367011" status: 202 len: 0 microversion: 2.1 time: 0.091201 Aug 01 08:16:37.346671 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 645/1288] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Aug 1 08:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1395367011 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:16:38.769399 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426c770e-ad10-4a93-995e-b9aad94cf076"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:38.771748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:38.774154 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:38.779656 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:38.780110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:38.780878 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:38.781311 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:38.798590 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:39.577583 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-93dff02d-6d1c-4c11-af44-2aa0b770c317 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811940 Aug 01 08:16:39.578327 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 644/1289] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 08:16:38 2022] POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:47.184167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:47.184785 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:47.187307 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=4 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:47.188009 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:47.193653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:47.194107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:47.200612 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:47.200612 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:47.321108 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:47.329086 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-63503619-fdb4-47c6-9f5f-3e2b3866c8a3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1592 microversion: 2.1 time: 0.149551 Aug 01 08:16:47.329645 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 646/1290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:47 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1592 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:16:49.715738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell0:SELECT=2 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:49.717003 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:16:49.721467 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-c4fa57c2-cb53-48ae-9acc-6bb9c0209862 req-cc651641-0c70-4eb4-bdee-ca8b088fad89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:49.732479 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-c4fa57c2-cb53-48ae-9acc-6bb9c0209862 req-cc651641-0c70-4eb4-bdee-ca8b088fad89 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:49.732927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-c4fa57c2-cb53-48ae-9acc-6bb9c0209862 req-cc651641-0c70-4eb4-bdee-ca8b088fad89 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:49.744229 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-c4fa57c2-cb53-48ae-9acc-6bb9c0209862 req-cc651641-0c70-4eb4-bdee-ca8b088fad89 service nova] Creating event network-changed:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:16:49.750046 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-c4fa57c2-cb53-48ae-9acc-6bb9c0209862 req-cc651641-0c70-4eb4-bdee-ca8b088fad89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035741 Aug 01 08:16:49.750711 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 645/1291] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:52.490279 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1300287971"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:52.494996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:52.497236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:52.498504 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:52.499260 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:52.499719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:52.626812 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.network.security_group_api [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Adding security group 2ca266fe-6f8c-4ba2-a314-9c68334d32aa to port 6fd11185-c1f1-4a45-a5f8-44903b75afea Aug 01 08:16:53.020683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-7698ff47-7b74-4fbb-85f0-b9662ccfccf3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/action" status: 202 len: 0 microversion: 2.1 time: 0.534095 Aug 01 08:16:53.021318 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 647/1292] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:16:52 2022] POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:16:53.031563 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:16:53.032537 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:16:53.040238 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:53.040696 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:53.042140 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:53.042717 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:53.050157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-75e519fc-52d5-47b0-9856-df4c86e7f18e req-ea742876-2a93-432d-afa2-e9aa5d5001ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:16:53.061016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-75e519fc-52d5-47b0-9856-df4c86e7f18e req-ea742876-2a93-432d-afa2-e9aa5d5001ee service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:16:53.061815 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-75e519fc-52d5-47b0-9856-df4c86e7f18e req-ea742876-2a93-432d-afa2-e9aa5d5001ee service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:16:53.073893 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-75e519fc-52d5-47b0-9856-df4c86e7f18e req-ea742876-2a93-432d-afa2-e9aa5d5001ee service nova] Creating event network-changed:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:16:53.081597 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-75e519fc-52d5-47b0-9856-df4c86e7f18e req-ea742876-2a93-432d-afa2-e9aa5d5001ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037543 Aug 01 08:16:53.085427 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 648/1293] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:16:53.292472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:16:53.301817 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-f29d9e62-5bfa-4236-9859-6bae683af057 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1757 microversion: 2.1 time: 0.275928 Aug 01 08:16:53.303173 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 646/1294] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:16:53 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1757 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:51.798381 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=5 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:17:51.799119 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=12 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:17:51.803248 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:17:51.805592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:51.811917 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:51.812395 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:51.813154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:51.813588 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:52.002061 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-33f72cff-14fd-475c-a735-de3635ff0c77 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/action" status: 202 len: 0 microversion: 2.1 time: 0.205127 Aug 01 08:17:52.002683 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 649/1295] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:17:51 2022] POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:17:52.012810 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:52.013668 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:52.015978 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=4 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:17:52.016689 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:17:52.021485 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:52.021927 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:52.023013 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:52.023458 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:52.208987 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:52.217171 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-cef82c0b-554d-497c-8bb7-20d03cdd38e2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1749 microversion: 2.1 time: 0.210099 Aug 01 08:17:52.217744 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 647/1296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:52 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1749 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:53.240452 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:53.241180 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:53.247631 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:53.251722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:53.251722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:53.251722 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:53.396529 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:53.405340 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-ec539a3b-6bd6-48dc-951a-37e003056fa3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.169754 Aug 01 08:17:53.405902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 650/1297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:53 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:54.427241 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:54.427875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:54.434112 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:54.434561 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:54.435321 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:54.435785 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:54.578106 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:54.585968 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-8bb138ff-25bf-431a-989a-5405a5d7e3a5 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.162574 Aug 01 08:17:54.586517 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 648/1298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:54 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:55.608862 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:55.609456 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:55.615866 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:55.616309 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:55.617051 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:55.617477 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:55.758839 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:55.767391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-75fb4fcc-054a-4f8b-afc2-84f583b894e1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.163016 Aug 01 08:17:55.767984 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 651/1299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:55 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:56.789701 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:56.790319 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:56.797408 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:56.797862 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:56.798633 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:56.799073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:56.947541 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:56.955469 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-e35fab72-8b81-4071-8862-2af8c1777bdb tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.169922 Aug 01 08:17:56.956073 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 649/1300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:56 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:57.977245 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:57.977850 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:57.984863 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:57.985302 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:57.986043 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:57.986470 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:58.131154 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:58.139267 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-cd329844-ca99-4842-bc34-deb9313cee20 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.165974 Aug 01 08:17:58.139849 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 652/1301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:57 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:17:59.160499 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:17:59.161370 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:17:59.167896 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:59.168355 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:59.169643 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:17:59.170242 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:17:59.319188 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:17:59.327280 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-d5a3c08e-cb4f-4dda-a4f6-3b78dc77f9d6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.170632 Aug 01 08:17:59.327875 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 650/1302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:17:59 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:00.348016 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:00.348759 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:00.355172 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:00.355645 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:00.356395 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:00.357385 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:00.496367 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:00.504294 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-27073a0b-648e-43b7-8492-17a9b1d293e6 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.160094 Aug 01 08:18:00.504860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 653/1303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:00 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:01.526117 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:01.526740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:01.533940 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:01.534398 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:01.535159 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:01.535635 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:01.676655 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:01.685107 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-54cb9278-f4fa-4e7c-ada9-b42bc86b8a4a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.162359 Aug 01 08:18:01.685684 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 651/1304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:01 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:02.706592 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:02.707207 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:02.713781 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:02.714229 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:02.714985 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:02.715418 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:02.856289 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:02.864859 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-dc30fd59-b567-4c80-8a06-377c9d793d15 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.162073 Aug 01 08:18:02.865422 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 654/1305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:02 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:03.886550 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:03.887201 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:03.894392 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:03.894842 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:03.895623 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:03.896061 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:04.036522 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:04.044424 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-34f32c5c-b62e-490e-827c-419a5ac80ac1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.161731 Aug 01 08:18:04.044991 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 652/1306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:03 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:05.066014 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:05.066598 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:05.073157 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:05.073607 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:05.074369 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:05.074805 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:05.221630 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:05.230339 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6c098b13-eb09-441c-b80f-61a29131570e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.168309 Aug 01 08:18:05.230902 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 655/1307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:05 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:06.252029 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:06.252689 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:06.259135 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:06.259616 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:06.260391 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:06.260861 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:06.404738 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:06.412787 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-18a90d38-f7f0-4b68-8de7-50f7d0294694 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.164672 Aug 01 08:18:06.413352 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 653/1308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:06 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:07.433047 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:07.433663 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:07.440604 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:07.441054 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:07.441811 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:07.442249 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:07.582662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:07.591173 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-72fb5be0-629b-4356-b97a-a89d44c2db0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.161351 Aug 01 08:18:07.591874 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 656/1309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:07 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:08.612375 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:08.612989 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:08.619461 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:08.619942 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:08.620699 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:08.621130 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:08.759928 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:08.768218 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-5215fb84-6a52-4b25-813f-058ecf6466b2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1754 microversion: 2.1 time: 0.159618 Aug 01 08:18:08.768719 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 654/1310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:08 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:09.789471 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:18:09.790101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:18:09.797000 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:09.797440 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:09.798183 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:18:09.798611 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:18:09.944142 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:18:09.952251 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6edd46f2-da50-41ea-b4b5-dc511db77226 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1757 microversion: 2.1 time: 0.166707 Aug 01 08:18:09.952837 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 657/1311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:18:09 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:18:41.668742 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:18:41.669455 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Mon Aug 1 08:18:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:18:47.159473 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:18:47.160095 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Mon Aug 1 08:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:19:13.204558 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_api:SELECT=16 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:19:13.205313 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG dbcounter [-] [118233] Writing DB stats nova_cell1:SELECT=48 {{(pid=118233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:19:13.209294 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1300287971"}} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:19:13.209829 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:13.215734 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:13.216285 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:13.217055 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:13.217496 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:13.342196 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.network.security_group_api [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Removing security group 2ca266fe-6f8c-4ba2-a314-9c68334d32aa from port 6fd11185-c1f1-4a45-a5f8-44903b75afea Aug 01 08:19:13.695086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-9d047607-b260-481d-b7c8-b54cf1d7f3d4 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/action" status: 202 len: 0 microversion: 2.1 time: 0.490875 Aug 01 08:19:13.695086 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 655/1312] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 08:19:13 2022] POST /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:19:13.704980 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_api:SELECT=18 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:19:13.705860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG dbcounter [-] [118232] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 08:19:13.962965 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [req-bcfa9f91-aec5-485d-8466-429376cb2305 req-dc02e26c-5d5f-42b8-a2ee-2e5646eeefde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:19:13.980378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-bcfa9f91-aec5-485d-8466-429376cb2305 req-dc02e26c-5d5f-42b8-a2ee-2e5646eeefde service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:13.980830 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [req-bcfa9f91-aec5-485d-8466-429376cb2305 req-dc02e26c-5d5f-42b8-a2ee-2e5646eeefde service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:14.004461 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.compute.server_external_events [req-bcfa9f91-aec5-485d-8466-429376cb2305 req-dc02e26c-5d5f-42b8-a2ee-2e5646eeefde service nova] Creating event network-changed:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:19:14.010957 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [req-bcfa9f91-aec5-485d-8466-429376cb2305 req-dc02e26c-5d5f-42b8-a2ee-2e5646eeefde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.312440 Aug 01 08:19:14.011974 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 658/1313] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:19:15.230070 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:15.230629 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:15.236949 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:15.237420 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:15.238192 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:15.238631 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:15.331791 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.objects.instance [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lazy-loading 'services' on Instance uuid 31bd574d-174f-40d2-85f3-ed6b7c25719f {{(pid=118233) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:19:15.546018 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-bcddc524-2b85-4992-a07f-bb3e89584412 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments/426c770e-ad10-4a93-995e-b9aad94cf076" status: 202 len: 0 microversion: 2.1 time: 0.320496 Aug 01 08:19:15.547213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 656/1314] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:19:15 2022] DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments/426c770e-ad10-4a93-995e-b9aad94cf076 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:19:15.556221 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:15.559992 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:15.567241 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:15.567719 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:15.568480 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:15.568908 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:15.598933 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-6035a0b4-80e2-44fc-8615-70cd0655561a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047378 Aug 01 08:19:15.600883 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 659/1315] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:19:15 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:19:16.026357 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-794a5149-c90e-4d53-9130-fc8aa8eeb617 req-cef978e9-02b7-4b2c-be50-3f4a2bbc9c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:19:16.037087 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-794a5149-c90e-4d53-9130-fc8aa8eeb617 req-cef978e9-02b7-4b2c-be50-3f4a2bbc9c8f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:16.037543 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-794a5149-c90e-4d53-9130-fc8aa8eeb617 req-cef978e9-02b7-4b2c-be50-3f4a2bbc9c8f service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:16.050564 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-794a5149-c90e-4d53-9130-fc8aa8eeb617 req-cef978e9-02b7-4b2c-be50-3f4a2bbc9c8f service nova] Creating event network-changed:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:19:16.055763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-794a5149-c90e-4d53-9130-fc8aa8eeb617 req-cef978e9-02b7-4b2c-be50-3f4a2bbc9c8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033337 Aug 01 08:19:16.056442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 657/1316] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:19:16.611394 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:16.614561 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:16.622442 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:16.623272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:16.624063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:16.624491 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:16.656122 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-405cd8ea-732d-40aa-8602-c40acf148c1e tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048681 Aug 01 08:19:16.656709 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 660/1317] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:19:16 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:19:17.669748 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:17.672012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:17.678221 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:17.678675 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:17.679442 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:17.679909 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:17.708138 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-95d7086d-d87f-4238-8e3f-1d39ba6f53d3 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043998 Aug 01 08:19:17.708686 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 658/1318] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 08:19:17 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 08:19:17.719833 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:17.720335 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:17.726653 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:17.727090 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:17.727860 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:17.728288 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:17.806236 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.wsgi [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] HTTP exception thrown: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f is not attached to volume 426c770e-ad10-4a93-995e-b9aad94cf076 Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Request method failure captured: Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: request: DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments/426c770e-ad10-4a93-995e-b9aad94cf076 HTTP/1.1 Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept: application/json Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Accept-Encoding: identity Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Connection: close Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Length: 0 Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Content-Type: application/json Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Host: 10.222.0.48 Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Openstack-System-Scope: None Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: User-Agent: python-urllib3/1.26.10 Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Auth-Token: gAAAAABi54u2WIMiIkWDja0GQDtgu9BWEqbj2PocBv7G7m2gS8qHEm1TsA1AZ77IPaFUoC229FjWtLfFy7GEWdeonXiMWCRCQ0adSq8B5Vo7QAIl2wmi44E0d_-KaWVoTSnxZDgCZwlE6PPZMQQIIsvVS8YMUBodjZIOmdZvTAZDFRtYO_3TOkE Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Id: None Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Domain-Name: None Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Identity-Status: Confirmed Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Is-Admin-Project: True Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Id: default Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Domain-Name: Default Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Id: 73e81c6e477a41ddb15e47b0c486b33e Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Project-Name: tempest-TestMinimumBasicScenario-933942896 Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Role: member,reader Aug 01 08:19:17.808567 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Roles: member,reader Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73e81c6e477a41ddb15e47b0c486b33e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73e81c6e477a41ddb15e47b0c486b33e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73e81c6e477a41ddb15e47b0c486b33e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73e81c6e477a41ddb15e47b0c486b33e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant: tempest-TestMinimumBasicScenario-933942896 Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Id: 73e81c6e477a41ddb15e47b0c486b33e Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-Tenant-Name: tempest-TestMinimumBasicScenario-933942896 Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User: tempest-TestMinimumBasicScenario-933942896-project Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Id: default Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Domain-Name: Default Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Id: 7d9d2555e71d4459b4fb907b764c1e79 Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: X-User-Name: tempest-TestMinimumBasicScenario-933942896-project Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: method: > Aug 01 08:19:17.810587 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: exception: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f is not attached to volume 426c770e-ad10-4a93-995e-b9aad94cf076 Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: action_args: {'server_id': '31bd574d-174f-40d2-85f3-ed6b7c25719f', 'id': '426c770e-ad10-4a93-995e-b9aad94cf076'} Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 426c770e-ad10-4a93-995e-b9aad94cf076. Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:19:17.811826 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f is not attached to volume 426c770e-ad10-4a93-995e-b9aad94cf076 Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f is not attached to volume 426c770e-ad10-4a93-995e-b9aad94cf076 Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR nova.api.openstack.wsgi Aug 01 08:19:17.813517 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Returning 404 to user: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f is not attached to volume 426c770e-ad10-4a93-995e-b9aad94cf076 {{(pid=118232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:19:17.815196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-99c1e8ce-d4f0-498d-9c42-d18ba80197be tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments/426c770e-ad10-4a93-995e-b9aad94cf076" status: 404 len: 154 microversion: 2.1 time: 0.095348 Aug 01 08:19:17.815196 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 661/1319] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 08:19:17 2022] DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f/os-volume_attachments/426c770e-ad10-4a93-995e-b9aad94cf076 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:19:19.084110 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:19.084615 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:19.091065 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:19.091740 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:19.092507 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:19.092952 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:19.116473 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Going to try to terminate instance {{(pid=118233) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 08:19:19.389508 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-6fbcb368-13b3-421b-8cbb-fbcd7d3cdf7b tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 204 len: 0 microversion: 2.1 time: 0.308870 Aug 01 08:19:19.390095 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 659/1320] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 08:19:19 2022] DELETE /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 08:19:19.398101 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:19.398704 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:19.405378 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:19.405822 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:19.406572 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:19.406996 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:19.540915 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:19:19.549058 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-14db16c7-7861-4c27-9cd6-4416f56c1e9f tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1552 microversion: 2.1 time: 0.154696 Aug 01 08:19:19.549614 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 662/1321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:19:19 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:19:20.570720 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:20.571431 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:20.578249 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:20.578703 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:20.579472 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:20.579936 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:20.707277 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.policy [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118233) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:19:20.715059 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-68882762-c280-4fca-a326-0a60d259ddd1 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1552 microversion: 2.1 time: 0.148574 Aug 01 08:19:20.716162 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 660/1322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:19:20 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:19:21.738205 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:21.738777 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:21.745664 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:21.748218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:21.748218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:21.748218 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:21.880889 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:19:21.890662 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-422437f7-eae8-4476-aafb-30cad3c96a3a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1552 microversion: 2.1 time: 0.156271 Aug 01 08:19:21.891324 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 663/1323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:19:21 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:19:21.941695 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [req-99b7ae5f-6361-44fa-a0be-9d82a235c17e req-ffb7a154-751f-4ca6-af9c-68434bd457c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bd574d-174f-40d2-85f3-ed6b7c25719f", "name": "network-vif-deleted", "tag": "6fd11185-c1f1-4a45-a5f8-44903b75afea"}]} {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 08:19:21.952958 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-99b7ae5f-6361-44fa-a0be-9d82a235c17e req-ffb7a154-751f-4ca6-af9c-68434bd457c4 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:21.953400 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [req-99b7ae5f-6361-44fa-a0be-9d82a235c17e req-ffb7a154-751f-4ca6-af9c-68434bd457c4 service nova] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:21.964324 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.compute.server_external_events [req-99b7ae5f-6361-44fa-a0be-9d82a235c17e req-ffb7a154-751f-4ca6-af9c-68434bd457c4 service nova] Creating event network-vif-deleted:6fd11185-c1f1-4a45-a5f8-44903b75afea for instance 31bd574d-174f-40d2-85f3-ed6b7c25719f on hv-cinder-74014 Aug 01 08:19:21.969403 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [req-99b7ae5f-6361-44fa-a0be-9d82a235c17e req-ffb7a154-751f-4ca6-af9c-68434bd457c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Aug 01 08:19:21.971235 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 661/1324] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 08:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 08:19:22.911872 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:22.912494 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.compute.api [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:22.919391 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:22.919926 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:22.920717 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:22.921146 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:22.952376 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:22.952818 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG oslo_concurrency.lockutils [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:22.953296 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.objects.instance [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lazy-loading 'fault' on Instance uuid 31bd574d-174f-40d2-85f3-ed6b7c25719f {{(pid=118232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 08:19:22.992450 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.policy [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d9d2555e71d4459b4fb907b764c1e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73e81c6e477a41ddb15e47b0c486b33e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 08:19:23.001063 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-81545746-5e19-4f2c-8060-6f8d666a26a2 tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 200 len: 1347 microversion: 2.1 time: 0.093476 Aug 01 08:19:23.001810 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 664/1325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:19:22 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 08:19:24.024048 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '>' {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:24.024783 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.compute.api [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [instance: 31bd574d-174f-40d2-85f3-ed6b7c25719f] Fetching instance by UUID {{(pid=118233) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 08:19:24.032020 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:24.032475 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:24.033501 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 08:19:24.033941 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG oslo_concurrency.lockutils [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Lock "a7e949bb-6181-44eb-9611-dda4f19e218a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 08:19:24.047315 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.wsgi [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] HTTP exception thrown: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f could not be found. Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Request method failure captured: Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: request: GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f HTTP/1.1 Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept: application/json Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Accept-Encoding: identity Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Connection: close Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Length: 0 Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Content-Type: application/json Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Host: 10.222.0.48 Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Openstack-System-Scope: None Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: User-Agent: python-urllib3/1.26.10 Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Auth-Token: gAAAAABi54u2WIMiIkWDja0GQDtgu9BWEqbj2PocBv7G7m2gS8qHEm1TsA1AZ77IPaFUoC229FjWtLfFy7GEWdeonXiMWCRCQ0adSq8B5Vo7QAIl2wmi44E0d_-KaWVoTSnxZDgCZwlE6PPZMQQIIsvVS8YMUBodjZIOmdZvTAZDFRtYO_3TOkE Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Id: None Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Domain-Name: None Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Identity-Status: Confirmed Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Is-Admin-Project: True Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Id: default Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Domain-Name: Default Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Id: 73e81c6e477a41ddb15e47b0c486b33e Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Project-Name: tempest-TestMinimumBasicScenario-933942896 Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Role: member,reader Aug 01 08:19:24.048956 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Roles: member,reader Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73e81c6e477a41ddb15e47b0c486b33e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73e81c6e477a41ddb15e47b0c486b33e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73e81c6e477a41ddb15e47b0c486b33e", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73e81c6e477a41ddb15e47b0c486b33e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}] Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant: tempest-TestMinimumBasicScenario-933942896 Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Id: 73e81c6e477a41ddb15e47b0c486b33e Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-Tenant-Name: tempest-TestMinimumBasicScenario-933942896 Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User: tempest-TestMinimumBasicScenario-933942896-project Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Id: default Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Domain-Name: Default Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Id: 7d9d2555e71d4459b4fb907b764c1e79 Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: X-User-Name: tempest-TestMinimumBasicScenario-933942896-project Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: method: > Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: exception: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f could not be found. Aug 01 08:19:24.050746 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: action_args: {'id': '31bd574d-174f-40d2-85f3-ed6b7c25719f'} Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: {{(pid=118233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f could not be found. Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 08:19:24.051794 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f could not be found. Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f could not be found. Aug 01 08:19:24.053439 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: ERROR nova.api.openstack.wsgi Aug 01 08:19:24.055042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: DEBUG nova.api.openstack.wsgi [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Returning 404 to user: Instance 31bd574d-174f-40d2-85f3-ed6b7c25719f could not be found. {{(pid=118233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 08:19:24.055042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO nova.api.openstack.requestlog [None req-98d842ce-749a-461f-a52a-aa81d9946f0a tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f" status: 404 len: 111 microversion: 2.1 time: 0.030680 Aug 01 08:19:24.055042 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: [pid: 118233|app: 0|req: 662/1326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 08:19:24 2022] GET /compute/v2.1/servers/31bd574d-174f-40d2-85f3-ed6b7c25719f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 08:19:24.059064 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: DEBUG nova.api.openstack.wsgi [None req-b1ebc43a-d443-49d3-b1e9-f99dcae19aea tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] Calling method '.version_select at 0x7efe47cd0f70>' {{(pid=118232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 08:19:24.064454 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1ebc43a-d443-49d3-b1e9-f99dcae19aea tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [686912f7-c62f-4f56-b174-e9704ec4aea2] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 08:19:25.072167 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1ebc43a-d443-49d3-b1e9-f99dcae19aea tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] [686912f7-c62f-4f56-b174-e9704ec4aea2] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 39914. Aug 01 08:19:25.258814 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO nova.api.openstack.requestlog [None req-b1ebc43a-d443-49d3-b1e9-f99dcae19aea tempest-TestMinimumBasicScenario-933942896 tempest-TestMinimumBasicScenario-933942896-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-629073726" status: 202 len: 0 microversion: 2.1 time: 1.203348 Aug 01 08:19:25.259401 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: [pid: 118232|app: 0|req: 665/1327] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Aug 1 08:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-629073726 => generated 0 bytes in 1205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 08:20:27.197967 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:20:27.198618 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Mon Aug 1 08:20:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:22:01.677012 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:22:01.677626 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Mon Aug 1 08:22:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:22:07.168383 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:22:07.168997 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Mon Aug 1 08:22:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:22:20.807763 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:22:20.808213 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Mon Aug 1 08:22:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:22:23.456538 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:22:23.457107 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Mon Aug 1 08:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:23:47.206536 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:23:47.207139 dv-cinder-740146-16-iscsi devstack@n-api.service[118233]: Mon Aug 1 08:23:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 08:24:26.543397 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 08:24:26.544272 dv-cinder-740146-16-iscsi devstack@n-api.service[118232]: Mon Aug 1 08:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!